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Abstract — We give a proof of the threshold saturation phe- 
nomenon for all spatially coupled graphical models which, in 
the large size limit, can be characterized by a one-dimensional 
real-valued state. This includes spatially coupled irregular LDPC 
codes over the BEC, but also addresses hard-decision decoding 
for transmission over general channels, the CDMA multiple- 
access problem, and some statistical physics models. 

Recall that for iterative coding systems with two components 
and transmission over the BEC, the asymptotic convergence 
behavior is completely characterized by the EXIT curves of the 
components. More precisely, the system converges to the desired 
fixed point corresponding to perfect decoding if and only if the 
two EXIT functions describing the components do not cross. 

For spatially coupled systems whose state is one-dimensional 
a closely related graphical criterion applies. Now the curves 
are allowed to cross, but not by too much. More precisely, we 
show that the threshold saturation phenomenon is related to 
the positivity of the area enclosed by two EXIT-like functions 
associated to the component systems, a very intuitive and easy 
to use graphical characterization. 

In the spirit of EXIT functions and Gaussian approximations, 
we also show how to apply the technique to higher dimensional 
and even infinite-dimensional cases. In these scenarios the method 
is no longer rigorous, but it typically gives accurate predictions. 
To demonstrate this application, we discuss transmission over 
general channels using both the belief-propagation as well as the 
min-sum decoder. 



I. Introduction 

The idea of spatial coupling emerged in the coding context 
from the study of Low-Density Parity-Check Convolutional 
(LDPCC) codes. LDPCC codes were introduced by Felstrom 
and Zigangirov [1|. We refer the reader to 0, 0, j4), as 
well as to the introduction in [6] which contains an extensive 
review. It has long been known that LDPCC codes outperform 
their block coding counterparts Q, 0, 0, 0. Subsequent 
work isolated and identified the key system structure which is 
responsible for this improvement. 

In particular, it was conjecture in [6 1 that spatially coupled 
systems have a performance which is equal to the perform 
of the underlying uncoupled system if one were able to 
process it optimally. This was termed "threshold saturation" 
phenomenon and a rigorous proof of the threshold saturation 
phenomenon over the BEC and regular LDPC ensembles 
was given. The proof was generalized to all binary-input 
memoryless output-symmetric (BMS) channels in iflOl . From 



these proofs it follows that universal capacity-achieving codes 
for BMS channels can be constructed by spatially coupling 
regular LDPC codes. Spatial coupling has also been success- 
fully applied to the CDMA multiple-access channel (Til, C3, 
to compressed sensing 1131 . fl4l . Ifl5l . to the Slepian-Wolf 
coding problem fl6l . to models in statistical physics fTTl . fT8l . 
and to many other problems in communications, statistical 
physics and computer science, see fW\ for a review. 

The purpose of this paper is two-fold. First, we give a 
rigorous proof of the threshold saturation phenomenon for 
all coupled graphical models where, in the large sized limit, 
the underlying component graph has a one-dimensional real- 
valued state. This includes spatial coupling of irregular LDPC 
codes over the BEC, but it also addresses other cases like hard- 
decision decoding for transmission over general channels, and 
the CDMA multiple-access problem ifTTl . Ifl2l . As mentioned 
above, transmission over the BEC using spatially-coupled 
regular LDPC codes was already solved in |6|, but our current 
set-up is more general. Whereas the proof in [6| depends 
on specific features of the BEC, here we derive a graphical 
characterization of the threshold saturation phenomena in 
terms of EXIT-like functions that define the spatial system. 
This broadens the range of potential applications considerably. 

To be concrete, consider the example of coding over the 
BEC. In the traditional setup the condition for successful 
decoding reduces to the two EXIT charts not crossing. We 
will show that the EXIT condition for good performance of the 
spatially-coupled system is significantly relaxed and reduces 
to a condition on the area bounded between the component 
EXIT functions. 

This is best demonstrated by a simple example. Consider 
transmission over the BEC using the (3,6) ensemble. Fig- 
ure shows the corresponding EXIT charts for e = 0.45 and 
e = 0.53. Note that both these channel parameters are larger 
than the BP threshold which is e BP 0.4294. In the left-hand 
side, if we consider the area bounded by the two EXIT charts 
when we start at and integrate till u then this area is positive 
for all u <E [0, 1]. This property guarantees that the decoder 
for the spatially coupled system succeeds for this case. In the 
right-hand side, to the contrary, the area becomes negative at 
some point (the total area in white is smaller than the total 
area in dark gray) and by our condition this implies that the 
decoder for the spatially coupled system does not succeed. 
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Fig. 1. Both pictures show the EXIT curves for the (3,6) ensemble and 
transmission over the BEC. Left: e = 0.45. In this case A = 0.03125 > 0, 
i.e., the white area is larger than the dark gray area. Right: e = 0.53. In this 
case A = —0.0253749 < 0, i.e., the white area is smaller than the dark gray 
area. 

The threshold of the spatially coupled system is given by that 
channel parameter so that the area in white and the area in 
dark gray are exactly equal. 

This simple graphical condition is the essence of our result 
and applies regardless whether we look at coding systems or 
other graphical models. For any system characterized by two 
EXIT functions, plot these two functions and consider the area 
between them starting from to a point u. As long as this 
area is positive for all u G (0, 1] the iterative process succeeds. 
Indeed, we will even be able to make predictions on the speed 
of the process based on the "excess" area we have. 

A few points can immediately be concluded from such 
a picture. First, if the threshold of the uncoupled system 
is determined by the so-called stability condition, i.e., the 
behavior of the EXIT charts for u around then spatial 
coupling does not increase the threshold. Indeed, if we increase 
the parameter beyond what is allowed according to the stability 
condition, the area will become negative around 0. Second, if 
the curves only have one non-trivial crossing (besides the one 
at and at the right end point) then the threshold is given by 
a balance of the two enclosed areas. 

For "nice" EXIT charts (e.g., continuous, and a finite num- 
ber of crossings) the above picture contains all that is needed. 
But since we want to develop the theory for the general case, 
some care is needed when defining all relevant quantities. 
When reading the technical parts below, it is probably a good 
idea to keep the above simple picture in mind. For readers 
familiar with the so-called Maxwell conjecture, it is worth 
pointing out that the above picture shows that this conjecture is 
generically correct for coupled systems. To show that it is also 
correct for uncoupled systems one needs to show in addition 
that under MAP decoding the coupled and the uncoupled 
system behave identically. This can often be accomplished 
by using the so-called interpolation method. For e.g., regular 
ensembles with no odd check degrees this second step was 
shown to be correct in lfl9l . 

Let us point out a few differences to the set-up in [6]. First, 
rather than analyzing directly the spatially-discrete system, key 
results are established in the limit of continuum spatial com- 
ponents. We will see that for such systems the solution for the 
coupled system is characterized in terms of traveling waves. 
The spatially discrete version then arises when sampling the 



continuum system. The existence of traveling wave solutions 
and their relationship to the EXIT charts of the underlying 
component systems is the essential content of the main results 
and so does not depend on information theoretic aspects of 
the coding case. 

The second purpose of this paper is to show that herein- 
developed one-dimensional theory can model many higher- 
dimensional or even infinite-dimensional systems to enable 
accurate prediction of their performance. This is very much 
in the spirit of the use of EXIT charts and Gaussian approx- 
imations for the the design of iterative systems. Using this 
interpretation, we apply our method to channel coding over 
general channels. Even though the method is no longer rigor- 
ous in these cases, we show that our graphical characterization 
gives very good predictions on the system performance and 
can therefore provide a convenient design tool. 

Recently several alternative approaches to the analysis of 
spatially-coupled systems have been developed independently 
by various authors |20l . fl5l . l2Tl . 1221 . These approaches 
share some important aspects with our work but there are also 
some important differences. Let us quickly discuss this. 

In ll20l the authors introduce a potential function whose 
stationary points are the fixed points of density evolution. They 
provide several interesting insights into the behavior of the 
coupled systems based on the value of the potential function. 

In lfT31 a proof was given that spatially coupled measure- 
ment matrices, together with a suitable iterative decoding 
algorithm, the so-called approximate message-passing (AMP) 
algorithm, allows to achieve the information theoretic limits of 
compressive sensing in a wide array of settings. The key tech- 
nical idea is to show that the iterative system is characterized in 
the limit of large block sizes by a one-dimensional parameter 
(which in this case represents per-coordinate mean square 
error) and which can be tracked faithfully by state evolution 
equations. To ease the analysis the authors consider continuum 
state evolution equations. The discrete state evolution is then 
obtained by sampling the continuous state evolution equations. 
The most important ingredient of the proof is to construct an 
appropriate free energy or potential function for the system so 
that the fixed points of the state evolution are the stationary 
points. Then it is shown that if the under-sampling ratio is 
greater than the information dimension, the solution of the 
state evolution can be made arbitrarily small. Suppose this 
did not happen then by perturbing slightly the non-trivial 
fixed point (the solution is "moved" inside) one can show 
that the potential strictly decreases. However, since the fixed 
point is a stationary point of the potential function, we get a 
contradiction. 

In (21 j, [22] the two main ingredients are also the character- 
ization of the iterative system by a one-dimensional (or finite- 
dimensional) parameter and the construction of a suitable 
potential function whose stationary points are the fixed points 
of density evolution. A significant innovation introduced in 
||2TI . l22l is that it is shown how to systematically construct 
such a potential function in a very general setting. This makes 
it possible to apply the analysis for a wide array of setting and 
provides a systematic framework for the proof. In addition, this 
framework allows not only to attack the scalar case but can 
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be carried over to vector-valued states. 

Our starting point is the set of EXIT functions, a familiar 
tool in the setting of iterative systems. From this we con- 
struct our "potential" by integrating. In our approach we also 
simplify our analysis by considering a continuous version of 
density evolution and then by connecting with the discrete 
version via a sampling theorem. Perhaps one of the strong 
points of the current paper is that it gives a fairly detailed 
and complete picture of the system behavior. I.e., we do 
not only characterize the threshold(s) but we also are able 
to characterize how the system converges to the various FPs 
(these are the wave solutions) and how fast it does so. 

The outline of the paper is as follows. In Section H2 we 
consider an abstract system, characterized by two EXIT-like 
functions. In terms of these functions we state a graphical cri- 
terion for the occurrence of threshold saturation. In Section HIT1 
we then apply the method to several one-dimensional systems. 
We will see that in each case the analysis is accomplished in 
just a few paragraphs by applying the general framework to 
the specific setting. In Section [TV] we develop a framework 
that can be used to analyze higher-dimensional systems in a 
manner analogous to the way the Gaussian approximation is 
used together with EXIT charts in iterative system design. We 
also show by means of several examples that this approach 
typically gives accurate predictions. In Section [V] we give a 
proof of the main results. Many of the supporting lemmas and 
bounds are relegated to the appendix. 

II. Threshold Saturation in One-Dimensional 
Systems 

In this section we develop and state the main ingredients 
which we will later use to analyze various spatially coupled 
systems. Although in most cases we are ultimately interested 
in "spatially discrete" and "finite-length" coupled systems, 
i.e., systems where we have a finite number of "components" 
which are spatially coupled along a line, it turns out that 
the theory is more elegant and simpler to derive if we start 
with spatially continuous systems stretching from — oo to oo. 
Once a suitably defined continuous system is understood, one 
can make contact with the actual system at hand by spatially 
discretizing it and by imposing specific boundary conditions. 

Throughout this section we use the example of the spatially- 
coupled (d;, d, ) -regular LDPC ensemble. 

Example 1 f(d/, d r , w, L) Ensemble): The (d(, d r , w, L) 
random ensemble is defined as follows, see |6|. In the ensuing 
paragraphs we use [a, a + b]A, for integers a and b, b > 0, 
and the real non-negative number A, to denote the set of 
points oA, (a + 1)A, . . . , (a + b)A. 

We assume that the variable nodes are located at positions 
[—L,L]A, where L G N and A > 0. At each position there 
are M variable nodes, M G N. Conceptually we think of the 
check nodes as located at all positions [— oo, oo]A. Only some 
of these positions actually interact with the variable nodes. 
At each position there are ^-M check nodes. It remains to 
describe how the connections are chosen. 

We assume that each of the d; connections of a variable 
node at position iA is uniformly and independently chosen 



from the range [i — w, . . . , i + w] A, where w is a "smoothing" 
parameter. In the same way, we assume that each of the d r 
connections of a check node at position i is independently 
chosen from the range [i — w, . . . ,i + w]A. Note that this 
deviates from the definition in [6| where the ranges were 
[i, ... ,i + w — 1}A and [i — w+ 1, . . . , i]A respectively. In our 
current setting the symmetry of the current definition simplifies 
the presentation. The present definition is equivalent to the 
previous one with w replaced by 2w + 1. 

This ensemble is spatially discrete. As we mentioned earlier, 
it is somewhat simpler to start with a system which is spatially 
continuous. We will discuss later on in detail how to connect 
these two points of view. Just to get started - how might one go 
from a spatially discrete system as the (d;, d r , w, L) ensemble 
to a spatially continuous system? Assume that we let A tend 
to and L and w tend to infinity so that LA and wA are 
held constant. In this case we can imagine that in the limit 
there is a component code at each location x G (— oo, +oo) 
in space and that a component at position x "interacts" with 
all components in a particular "neighborhood" of x. □ 

Consider a system on (— oo, +oo) (the spatial component) 
whose "state" at each point (in space) is described by a scalar 
(more precisely an element of [0, 1]). This means, the state of 
the system at time t, t G N, is described by a function /*, 
where f t (x) G [0, 1], x G (— oo, oo). 

Example 2 ( Coding for the BEC): Consider transmission 
over a binary erasure channel (BEC) using the (di,d r ,w,L) 
ensemble described in Definition [TJ Then the "state" of each 
component code at a particular point in time is the fraction 
of erasure messages that are emitted by variable nodes at this 
iteration. Hence the state of each component is indeed an 
element of [0, 1]. □ 

Let hf and h g be two functions, hf,h g : [0, 1] — > [0, 1], so 
that h g (0) = h f (0) = and h f (l) = h g (l) = 1. We think 
of these two functions as EXIT-like functions describing the 
evolution of the underlying component system under an itera- 
tive operation. As such, they are assumed to be monotonically 
non-decreasing. 

Definition 1: We denote the space of non-decreasing func- 
tions [0, 1] — > [0, 1] by *[q,ii. A function h G ^[0,1] has right 
limits for x G (0, 1] and left limits for x G [0, 1). To simplify 
some notation we define h(0— ) = and h(l+) = 1. The 
function h is continuous at x if h(x—) — h(x+). 

Let ^(-00. +00) denote the space of non-decreasing func- 
tions on (—00, +00). We denote lim x _ i ._ 00 f(x) as /(— 00) 
lim^+oo f(x) as /(+00). We call a function / G *(-oo,+oo) 
interpolating if /(— 00) = and /(+00) = 1. 

In general we allow discontinuous functions. A version of 
a given h G ^[0,1] is any function in ^[0,1] that agrees with 
h at points of continuity of h. This means a version of h can 
have different values from h at points of discontinuity, but 
is still required to be non-decreasing. All versions of a given 
function are equivalent in, e.g., the L\ sense and we write 
hi = fi2 if hi and /12 are versions of each other. Similarly, 
we admit versions of functions in ^(-oo.+oo) an d we write 
fx = f?. if fx and fi are versions of each other. 

We say that a sequence h l — > h in ^[0,1] if hi(x) — > h(x) 
for all points of continuity of h. We use a similar definition 
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of convergence in * ( _ 00 +oo) . 

Any function h G ^[0,1] nas a we ll defined inverse in [0, 1], 
call it h^ 1 G ^[o.i]- This inverse is unique up to versions. 
Formally, we may set h^ 1 (y) to any value in the (non- 
empty) interval [sup{x : h(x—) < y},mi{x : h(x+) > y}]. 
Note that h^ 1 (x— ) and h~ 1 (x+) are uniquely determined 
for each x G [0,1]. Similarly, any function / G ^(-00, +00) 
has a well defined monotonically non-decreasing inverse in 
f^ 1 : [0, 1] — > [—00, 00] that is unique up to version and we 
define /~ x (0-) = -00 and / -1 (H-) = +00. 

We assume that the state of the underlying component 
system is described by iterative updates according to two 
functions hf,h g 6 ^[0,1] • In deference to standard nomen- 
clature in coding, we refer to these iterative updates as the 
density evolution (DE) equations. If we assume that v and u 
are scalars describing the component system state then these 
update equations are given by 



u f = h g {v l ), 
„t+l _ u .f.M 



hfiu*) 



(1) 



Example 3 (DE for the BEC): Consider a (d;, d r )-regular 



ensemble. Let X(x) 



1 and p(x) = x dr 1 , Let v l be 



the fraction of erasure messages emitted at variable nodes at 
time t and let it* be the fraction of erasure messages emitted 
at check nodes at iteration Let e be the channel parameter. 
Then we have 



u* = 1 - p(l - «*), 



eA(u') . 



(2) 



In words, we have the correspondences h g (v) = 1 — p(l — v), 
and hf(u) — eX(u), As written, the function hf(u) is not 
continuous at u = 1. More explicitly, hf(l) < 1, whereas we 
defined the right limit at 1 to be generically equal to 1. We 
will see shortly how to fix this. □ 
Let us now discuss DE for the spatial continuum version. 
Consider a spatially-coupled system with the following update 
equations: 



g t (x) = h g ((f t ®oj)(x)), 
f t+1 (x) = h f ((g t ®u;)(x)). 



(3) 



and 



Here, ® denotes the standard convolution operator on 
U) is an averaging kernel. 

Definition 2 (Averaging Kernel): An averaging kernel oj is 
a non-negative even function, lu(x) = lj(—x), of bounded 
variation that integrates to 1, i.e., J ui(x)dx = 1. We call ui 
regular if there exists W G (0, +00] such that lu(x) — for 
x £ [-W, W] and we have uj(x) > for x G (-W, W). 

We will generally assume a regular averaging kernel. This 
assumption can largely be dropped when hf and h g are 
continuous. 

Example 4 ( Continuous Version of DE for the BEC): If 
we specialize the maps to the case of transmission over the 

'Conventionally, in iterative coding these quantities are denoted by x and 
y. But since we soon will introduce a continuous spatial dimension, which 
naturally is denoted by x, we prefer to stick with this new notation to minimize 
confusion. 



BEC we get the update equations: 

g t (x) = l-p(l-(f t ®u)(x)), 
f t +\x) = e\((g t ®u;)(x)). 



(4) 



□ 

For notational compactness, for a function / G ^(-co.+oo); 
we will often use the notation /" to denote / ® uj. 

In the usual manner of EXIT chart analysis, it is convenient 
to consider simultaneously the plots of hf and the reflected 
plot of h g . More precisely, in the unit square [0, l] 2 , we 
consider the curves (u, hf(u)) and (h g (v), v) for w, u G [0, 1]. 
Density evolution (DE) of the underlying (uncoupled) iterative 
system can then be viewed as a path drawn out by moving 
alternately between these to curves (see Fig. |2}. This path has 
the characteristic "staircase" shape. The fixed points of DE 
of the uncoupled system correspond to the points where these 
two curves meet or cross. Assuming continuity of hf and h g , 
they are the points (u,v) such that (u,hf(u)) = (h g (v),v). 

To help with the discontinuous case we introduce the 
following notation. For any h G ^[0,1] we write 

u = h(y) 



*[o,i] 



to mean u G [h(v— ), h(v+)]. 

Definition 3 (Crossing Points): Given (hf,h g ) 
and we say that (u, v) is a crossing point if 

u = h g (v), and v = hf(u) . 

Equivalently, crossing points are those points (u, v) such that 
u = Kj (v) and v 4= h~ 1 {u). 

The set of all crossing points will be denoted x{hf, h g ). It 
is easy to see that h g ) is closed as a subset of [0, l] 2 . By 

definition of ^[0,1], we have (0,0) G x(/i/,/i/) and (1,1) G 
x(hf, h g ). We term (0, 0) and (1, 1) the trivial crossing points 
and denote the non-trivial crossing points by 

x °(hf,h g )=x(h f ,h g )\{(0,0),(l,l)}. 

If (it, v) G x(hf, hf) and hf and h g are continuous at u and 
v respectively then (u, v) is a fixed point of density evolution. 
In general, if (u,v) G x(hf,hf) then (it, v) is a fixed point 
of density evolution for some version of (hf,h g ). 

Lemma 1: For any hf,h g G ^[0,1] the set x(hf,h g ) 
is component-wise ordered, i.e., given (u\, Vi), (U2, V2) G 
x(hf,h g ) we have (u 2 - ui)(«2 - «x) > 0. 

Proof: Let (tti, V\), (1/2, W2) G x{hf, h g ). If u\ < 112 then 
hf(ui+) < hf(v,2—) and, since v\ < hf(ui+) and v-i > 
hf(u2 — ), we obtain vi < v-i- All other cases can be shown 
similarly. ■ 

For a set A, which may be a subset of [0, l] 2 or a subset 
of K, we introduce the notation 



(A), = {x : By G A, \y - x\ < e} . 



(5) 



Lemma 2: If (hy,h g ) — > (hf,h g ) then, for any S > we 
have x(hf,h g ) C (x(hfih g )) s for all i sufficiently large. 

Proof: Let (u, v) be a limit point of (u z , v l ) G x(hy, h g ). 
Since hy(u) ~ > hf(u) at points of continuity of hf it is easy 
to see that 

liminf hf(u l — ) > hf(u-) 
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and 

limsup/i^(w 4 +) < hf(u+) 

and it follows that v = hf(u). Similarly, u = h g (v). Hence, 
(u,v) &x(hf,h g ). M 
Example 5 (EXIT Chart Analysis for the BEC): Figure [2] 
shows the EXIT chart analysis for the (3, 6)-regular ensemble 
when transmission takes place over the BEC. The left picture 
shows the situation when the channel parameter is below the 
BP threshold. In this case we only have the trivial FP at (0,0). 
According to our definition we have (1, 1) as a crossing point, 
but it is not a FP of the given version. The right picture shows 
a situation when we transmit above the BP threshold. We now 
see two further crossings of the EXIT curves and so x(hf> hg) 
is non-trivial. As indicated previously, we would generally 
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Fig. 2. Left: The figure shows the EXIT functions hr(u) = e\(u) and 
hg{ v ) = 1 — P(l — v ) f° r me (3> 6)-regular ensemble and e = 0.35. Note 
that the horizontal axis is u and the vertical axis is v so that we effectively plot 
the inverse of the function 1 — p(l— «). Since 0.35 = e < e BP ks 0.4292, the 
two curves do not cross. The dashed "staircase" shaped curve indicates how 
DE proceeds. Right: In this figure the channel parameter is e = 0.5 > e Bp . 
Hence, the two EXIT curves cross. In fact, they cross exactly twice (besides 
the trivial FP at (0, 0)), the first point corresponds to an unstable FP of DE, 
whereas the second one is a stable FP. 

like hf and h g to be continuous at and 1 as this will make 
statements and proofs somewhat simpler. The analysis of the 
spatially coupled system rests on the portions of the EXIT 
curves lying between the extremal DE fixed points. Since 
the spatial coupling is a linear operation we can renormalize 
the EXIT curves without changing the system. Consider the 
DE equations stated in (0. If (u*,v*) is the largest (in both 
components) FP of the corresponding DE and if we define 
hf(u) — e\(uu*)/v* and h g (v) = (1 — p(l - vv*))/u* then 
system (Q]) is again equivalent to (f2| on the restricted domain 
but, in addition, the component functions are continuous at 
1. This rescaling is indicated in the right picture of Figure [2] 
through the dashed gray box. Since the standard (unsealed) 
EXIT chart picture is very familiar in the coding context, we 
will continue to plot the unsealed picture. But we will always 
indicate the scaled version by drawing a gray box as in the 
right picture of Figure |2 This hopefully will not cause any 
confusion. There is perhaps only one point of caution. The 
behavior of the coupled system depends on certain areas in 
this EXIT chart. These areas are defined in the scaled version 
and are different by a factor u*v* in the unsealed version. □ 
So far we have considered the uncoupled system and seen 
that its behavior can be characterized in terms of FPs (u, v), 
i.e., in terms of pairs (it, v), so that v t = v, u l = u, t > 1, 



fulfill (HJ. Equivalently these are the crossings of the two 
component EXIT charts. The behavior of the spatially coupled 
system can also be characterized by its FPs. For the spatially 
coupled system a FP is not a pair of scalars, but a pair of 
functions (f(x),g(x)) such that if we set f l (x) = f(x) and 
g t (x) = g(x), t > 1, then these functions fulfill (O. In fact, 
for the coupled system it is fruitful not only to look at FPs 
but slightly more general objects, namely waves. Here a wave 
is like a FP, except that we allow shifts. I.e., for (f(x),g(x)) 
fixed and for some real value s, if we set /*(&) = fix — st) 
and g t {x) = g(x — st), t > 1, then these functions fulfill 
We will see that the behavior of coupled systems is 
governed by the (non)existence of such waves. In turn, this 
(non)existence has a simple graphical characterization in terms 
of the component-wise EXIT functions and their associated 
FPs. This is the main technical result of this paper. In fact, 
the direction of travel of the wave depends in a simple way 
on the EXIT functions and the area bound by them. Note 
that one set of fixed points of the spatially coupled system 
are the constant functions corresponding the fixed points of 
the uncoupled system. It is the appearance of a new class of 
fixed points, and related wave-like solutions, that underlies the 
threshold saturation of spatial coupling. 

Definition 4 (Potential Functions): For any pair [hf, h g ) G 
SSf? Q 1 , and point (u, v) G [0, l] 2 , we define 

<S>{hf,h g ;u,v)=uv — / hf(x)dx — / h g (x)dx , 
Jo Jo 

and 

f -l r 

4>(hf,h g ;u,v)= / hj (x)dx + / h g (x)dx —uv. 
Jo Jo 

A straightforward calculation, noting that uhf(u) = 
Jo hf{x) dx + J hf{u) hj^y) dy and vh g (v) = fij h g {y) dy + 
j^M") Tj-i^ d x ; shows that for all versions of {hf, h g ) we 
have 

4>{h f ,h g ;h g {v),hf{u)) 

= $(h f ,h g ;u,v) + {u- h g (v))(v - h f (u)) . 

Discussion: The functionals (f> and <f> can both serve as poten- 
tial functions for the scalar system. Assuming continuity of hf 
and h g we have V$(/i/, h g ; u, v) = (v — hf{u),u — h g (v)) 
and V(j){hf,h g ;u,v) — (/ig 1 (w) — v, hj (u) — u). Thus, 
a crossing point (u, v) is a stationary point of <f> and </>. 
i.e., V$(hf,h g ;u,v) = V<j){hf ,h g ;u,v) — for (u, v) G 
X(hf,h g ). 

Lemma 3: The function (f>(hf,h g ;u,v) is convex in u for 
fixed v and convex in v for fixed u. In addition, for all (u, v) G 
[0, l] 2 we have 

(j>{h f ,h g ;u,v) > <f){hf,h g ;u,hf{u)) 
(f>{h f ,h g ;u,v) > <j>(hf,h g ;h g {v),v) 

with equality holding in the first case if and only if v G 
[hf(u— ), hf(u+)] and in the second case if and only if 

U G [hg{V-), hg{V+)]. 
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Proof: It is easy to check that <fi(hf, h g ; u, v) is Lipschitz 
(hence absolutely) continuous and we have almost everywhere 

Q 

—<f>(h f ,h g ; u, v) = h~ 1 (u) - v, 

a , (7) 

—4>(h f ,h g ;u,v) = hf 1 ^) - u. 

The lemma now follows immediately from the monotonicity 
(non-decreasing) of h~ 1 and hj 1 . ■ 

We have immediately the following. 

Corollary 1: If (u°,v°) G [0, l] 2 and we define {u t ,v t ) 
for t > 1 via (0 then 4>(h g , h g \u l ,v*) is a non-increasing 
sequence in t. For t > 1 the sequence («*,«*) is monotonic 
and converges to some (w*, u*) G x(hf> h g ). 

We will be most interested in the value of $ and <fi at 
crossing points — x{hf,h g ). It follows from (0) that 

<p(hf,h g ;u,v) = $(h f ,h g ;u,v) for all (w, u) G \(hf,h g ). 

Lemma 4: Assume <f>(hf,h g ;u,v) < tp(hf,h g ;u,v') and 
4>(hf,h g ;u,v) < 4>(hf,h g ;u',v) for (u',v') in some neigh- 
borhood of (u,v), then (it, v) G x(hf,h g ). 

Proof: Assume the conditions of the statement. 
From Lemma (convexity) we have <fi(hf,h g ;u,v) = 
4>(hf,h g ;u,hf(u)) = cj>(hf, h g ; h g (v), v) and cj>(h s ,h gi ) is 
constant on the line segment from (u,v) to (u,hf(u)) and 
on the segment from (u, v) to (h g (v), v). It follows from (0 
that we must have v = hf(u) and u = h g (v), which gives 
(u,v) G x(hf,h g ). M 

Definition 5 (Strictly Positive Gap Condition): We say that 
the pair of functions (hf, h g ) satisfies the strictly positive gap 
condition if h g ) is non-trivial and if 

(u,v) G x°{hf,h g ) => cj)(hf,h g ;u,v) > max{0, A(h f , h g )} 

where we define A(hf, h g ) — <fi(hf, h g ; 1, 1). We say that the 
pair of functions (hf,h g ) satisfies the positive gap condition 
(no longer strict) if x{hf,h g ) is non-trivial and 

(«, v) G X°(hf, h g ) => (j)(hf, h g ; u, v) > max{0, A(h fl h g )} . 

□ 

Discussion: The (strictly) positive gap condition is related to 
the existence of interpolating spatial fixed point solutions. In 
particular, we will see that systems possessing interpolating 
fixed point solutions must satisfy the positive gap condition 
and have A(hf,h g ) — 0. Systems satisfying the strictly 
positive gap condition with A(hf,h g ) = will be proven to 
possess interpolating spatial fixed point solutions. The cases 
where A(hf,h g ) ^ correspond to interpolating traveling 
wave solutions. 

Lemma 5 (Trivial Behavior): If h g ) is trivial then the 

system behavior is simplified and under DE, i.e., under (0), 
the only spatial fixed points are with /* and g l set to either the 
constant or the constant 1, one of which is stable and one 
of which is unstable. We get convergence of all initial values, 
other than the unstable spatial fixed point, to the stable spatial 
fixed point. 

Now that we have covered the "trivial" cases, let us consider 
the system behavior when is non-trivial. As we 

will see, it is qualitatively different. The value A(hf,h g ) = 
&(hf, h g \ 1, 1) = 4>(hf, h g \ 1, 1) plays an important role in the 



behavior of the system. This is why we introduced a special 
notation. The strictly positive gap condition implies a value 
for &(hf,h g ;u,v), (u,v) G x{hf,h g ) that is strictly larger 
than the values and A(hf,h g ) found at the two trivial fixed 
points. We will see that this condition is related to the existence 
of wave-like solutions that involve the interaction between the 
two trivial fixed points. 

Example 6 (Positive Gap Condition for the BEC): 
Figure Q] illustrates the (strictly) positive gap condition 
for the (3, 6)-regular ensemble when transmission takes place 
over the BEC. The left picture shows the situation when 
the channel parameter is between the BP and the MAP 
threshold of the underlying ensemble. The right picture 
shows the situation when the channel parameter is above the 
MAP threshold of the underlying ensemble. In both cases 
x(hf,h g ) contains one non-trivial FP (u,v) and for this 
FP Q(hf,h g ;u,v) > max{0,A}, i.e., both cases fulfill the 
strictly positive gap condition. 

In the first case A > 0, whereas in the second case A < 0. 
We will see in the subsequent Theorem Q] that this change of 
the sign of A leads to a reversal of direction of a wave-like 
solution to the system and hence to fundamentally different 
asymptotic behavior. Both pictures show the unsealed curve 
and the lightly shaded box shows what the picture would look 
like if we rescaled it so that the largest FP appears at (1,1). 

It is not hard to see that the strictly positive gap condition 
is necessarily satisfied for any hf, h g for which x(/i/, h g ) has 
a single non-trivial fixed point, and for which (0, 0) and (1, 1) 
are stable fixed points under DE (Q~|). □ 

Theorem 1 (Existence of Spatial Waves): Assume that ui is 
a regular averaging kernel. Let (hf, h g ) be a pair of functions 
in '5 [o,i] satisfying the strictly positive gap condition. 

Then there exist interpolating functions J 7 , Q G ^(-oo.+oo) 
and a real-valued constant s, satisfying sgn(s) = 
sgn(A(hf, h g )) and \s\ > \A(hf, ft ff )|/||cj||<x» such that setting 
f\x) = T(x - st) and g t (x) = Q(x - st) for t = 0, 1, . . . 
solves (01 . 

We remark that we can relax the regularity condition on oj 
if hf and h g are continuous; cf. Lemma [T9l 

Example 7 (Spatial FP for the BEC): Figure shows the 
spatial FPs whose existence is guaranteed by Theorem 
for the (3, 6) ensemble and transmission over the BEC. The 
top picture corresponds to the cases e = 0.45 and the 
bottom picture to the case e = 0.53. In both cases we used 
the smoothing kernel uj(x) = ^l{|a;|<i}- As predicted, in 
the first case the curve moves to the right by a value of 
0.142 > l^l/IHloo = 0.03125 x 2 = 0.06245 and in the 
second case the curve moves to the left by an amount of 
0.101 > l^l/IMU = 0.0253740 x 2 = 0.0507498. □ 

Theorem is the most fundamental result concerning the 
spatially coupled system, but applications are usually spatially 
discrete and often finite length. The analysis can be applied to 
these cases with suitable adjustments. As a first step we present 
a result analogous to Theorem0for a spatially discrete system. 
The DE equations for the spatially discrete version can be 
written as in the system (0 with the following modifications: 
the variable x is discrete, the averaging kernel is a discrete 
sequence, and the convolution operation is convolution of 
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0.4 
0.3 
0.2 
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-2 



-1 




Fig. 3. FPs whose existence is guaranteed by Theorem \T\ for the (3, 6) 
ensemble and transmission over the BEC. The top picture corresponds to the 
cases e = 0.45 and the bottom picture to the case e = 0.53. In both cases we 
used the smoothing kernel u>(x) = 5l{|a:|<i}- The dashed curve is the result 
of applying one step of DE to the solid curve. As predicted, in the top picture 
the curve moves to the right (the corresponding gap A in Figure [T]is positive) 
whereas in bottom picture the curve moves to the left (the corresponding gap 
A is negative). The shifts are 0.142 and —0.102, respectively. 



discrete sequences. The analysis views the spatially discrete 
problem as a sampled version of the continuum version. In the 
limit of infinitely fine sampling the discrete version converges 
to the continuum version. 

Let Xi = iA and let w be a non-negative function over AZ 
that is even, Wj = w_j, and sums to 1, 2~2i w i = 1. It is 
convenient to interpret w as a discretization of ui, i.e., 

/•(i+|)A 

W{ = / u}{z)Az. (8) 

./(»-§) A 

This relationship then makes it clear that the discrete "width" 
of spatial averaging is inversely proportional to A. A good 
example is the smoothing kernel u>(x) = 5l{|x|<iV If we 



set A 



then w, 



Given a [0,11 



2W+1 " ,w " " l ~ 2W+1 X {\i\<W}- 

valued function g defined on AZ we will call the function g G 



), defined as g(x) = g(xi) for x G [x% — A/2,Xi 



( — oo,-foo 

A/2), the piecewise constant extension of g. Note that by this 
definition, we have 



ufa - y)g{y)dy = 



Xj+A/2 



oo 

E , 

OO 



u{x t - y)g{y)dy 



i=—oo 



w i - j g{x j )dy. 



With this framework in mind, we can write the spatially 
discrete DE equations as follows. 



<? t (z i ) = /i ff ((/'®w)(x i )) 
f t+1 (x i ) = h f ((g t 
Example 8 ( Spatially Discrete DE for the BEC): 
g\xi) = l-p((f t ®Lj)(x i )), 
f t+1 (x i ) = e\({g t ®uj)(x i )). 



(9) 



(10) 



□ 



The following theorem shows that if A is small compared 
to |s| then the spatially discrete system can bounded by the so- 
lution that arises from the corresponding spatially continuous 
version. 



Theorem 2 (Spatially Discrete System): Assume that w is a 
discrete sequence related to a regular smoothing kernel oj as 
indicated in (HJ. Assume that (hf, h g ) is a pair of functions in 
^[0,11 satisfying the strictly positive gap condition. Let J 7 , G,s 
be the quantities guaranteed by Theorem Q] If, in system (O, 
f°(xi) < Tix,) (for all i) then f(xi) < J 7 {x l -{s-A)t) and 
if f fa) > F(xi) then /'(a;,-) > T{x l - (s + A)t). Similarly, 
if 9 (x^ <G{xi) (for all i) then g t {x i ) < Q(xi - (s - A)t) 
and if g°(xi) > G(xi) then g t {x i ) > Q{xi - (s + A)t). 
The proof is presented in appendix ID1 

Example 9 (FP of Discrete DE for the BEC): Show here a 
FP of the discrete version. State all numbers and say what we 
can conclude in this case. □ 

Finite length systems can usually be modeled by allowing 
spatial dependence of hf and/or h g . For example, in the 
LDPC-BEC case termination corresponds to setting hf = 
outside some finite region. The analysis is facilitated by 
and most closely follows the unterminated case with one- 
sided termination, e.g., setting hf = for x < 0. When 
A(hf,h g ) > we can apply Theorem 1 to conclude that 
infinite length unterminated system has a wave-like solution 
that converges point-wise to 0. Such a solution can often be 
used to upper bound the solutions for terminated cases to show 
that their solutions also tend to 0. 

Since setting hf = over some region reduces / relative 
to the unterminated case, it is more difficult to obtain lower 
bounds for the terminated case. It turns out for one-sided 
termination, however, that an analogy can be drawn between 
the spatial variation in hf and a global perturbation in hf 
that is spatially invariant and which then allows application of 
Theorem [T] 

Let us formally define the one-sided termination version of 
(f3]l to be the system that follows (f3l) except that when x < 
we set /*(#) = 0. This is equivalent to redefining hf = 
hf(x\u) to have spatial dependence so that when x < we 
have hf(x;u) = and for i>0we have hf(x;u) = hf(u) 
as before otherwise. 

Since this system is not translation invariant, it does not 
admit traveling wave-like solutions. It does, however, have 
interpolating spatial fixed points. 

Theorem 3: Assume to is regular. Let (hf,h g ) satisfy the 
strictly positive gap condition and assume that A(hf, h g ) < 0. 
Then there exists interpolating J 7 , Q E ^(-oo.+oo) mat form a 
fixed point of the one-sided termination of ([3). 

Proof: Let hf be a modification of hf where hf(u) = 
hf(u) for u > u' and hf(u) = for u < vf where u' is 
chosen so that A(hf,h g ) = 0. By Theorem Q] there exists 
T,Q G ^[-co.oo] mat form a interpolating spatial fixed point 
(s = 0) for (01 with hf replacing hf. It is easy to see that 
there is some finite maximal y such that T{x) — for x < y. 
Translate T and Q so that y = 0. It follows that the resulting 
J 7 , Q pair is a fixed point of the one-sided termination version 
of ©. ■ 

For the case A(hf,h g ) > we have the following. 

Theorem 4: Assume cj is regular. Let (hf,h g ) satisfy the 
strictly positive gap condition and assume that A(hf, h g ) > 0. 
Then /* — >■ for the one-sided termination of © for any 



s 



choice of f°. If hf(x) > and h g (x) > on (0,1] then 
/'->0 also when A(h f ,h g ) = 0. 
The proof is presented in Appendix [D] 

We can, of course, also terminate the spatially discrete ver- 
sions of the system. Thus, consider the one sided termination 
of (O in which the equations are modified so that we set 
f l (xi) = if Xi < 0, which is equivalent to redefining hf to 
have spatial dependence so that hf — if x.- L < 0. We assume 
that w is related to to (for a continuum version) as indicated 
in ([§}. For this case we have the following. 

Theorem 5: Assume ui is regular. Let (hf,h g ) satisfy the 
strictly positive gap condition and assume that A(hf,h g ) < 
— AHwjloo. Then there exists T,Q G ^i- 



( — 00, +00) 



that form a 



spatial fixed point of the one-sided termination of ((9^. 

Proof: Let hf be a modification of hf where hf(u) = 
hf(u) for u > z and hf(u) = for u < z where z > is 
chosen sufficiently small so that A(hf,h g ) < — A^Hoo. By 
Theorem Q] there exists F.Ge ^[-oc,oo] mat form a spatial 
wave solution for (0) with hf replacing hf and s < —A. 
By Theorem |2] we see that by setting f°(Xi) = J-(xi) in 
(O (the non-terminated case) we have f x {xi) > J-(xi). By 
translation, we can assume that J-(xi) — for xi < 0. Now, 
the inequality f l {xi) > ^(xi) also holds in the one sided 
terminated case since the values of are unchanged for 

Xi > 0. Thus, in the one-sided termination case the sequence 
/* is monotonically non-decreasing for each Xi and must 
therefore have a limit f°°. If hf and h g are continuous then 
the pair f 00 ^ 00 then constitute a fixed point (J 7 , Q) of the 
one-sided termination case. If hf and h g are not continuous 
then it is possible that the pair f°° , g°° does not constitute a 
fixed point and that initializing with f°° we obtain another 
non-decreasing sequence. In general we can use transfinite 
recursion together with monotonicity in x to conclude the 
existence of a fixed point (J-,Q) > (J 00 ,!? 00 ) point-wise. We 
omit the details. ■ 

For the case A(hf,h g ) > we have the following. 

Theorem 6: Assume that lu is regular. Let (hf,h g ) sat- 
isfy the strictly positive gap condition and assume that 
A(hf,h g ) > AH^IIoo. Then /* for the one-sided 
termination of © for any choice of f°. 
The proof is presented in appendix [D] 

The two-sided termination of system (01 is defined by set- 
ting f l {x) = for all x outside some finite region, say [0, Z] 
for all t. This can be understood as having a spatial dependence 
on hf = hf(x;u) where hf(x;u) — for x $ [0,Z] and 
hf(x;u) = hf(u) as before otherwise. This system can be 
bounded from above by the one-sided termination case. Thus, 
Theorem [4] and Theorem [6] apply equally well to the two- 
sided terminated case. Theorem [5] on the other hand does not 
immediately generalize, but a similar statement holds. 

Theorem 7: Assume that lu is regular. Let (hf,h g ) satisfy 
the strictly positive gap condition and let A(hf, h g ) < 0. Then, 
for any e > 0, and for all Z sufficiently large, there exists J 7 , Q 
that form a fixed point of the two-sided termination of OJ. 
Furthermore, T and Q are symmetric about ^ , monotonically 
non-decreasing on (— oo, 4 ] and have left and right limits at 
least 1 — e at -f . 

The proof is presented in appendix [D] 



We have also the following spatially discrete version of the 
above, whose proof is also in appendix [D] 

Theorem 8: Assume that lu is regular. Let (hf,h g ) sat- 
isfy the strictly positive gap condition and assume that 
A(hf,h g ) < — AH^Hoo. Then, for any e > 0, and for all 
Z sufficiently large, there exists J 7 , Q that form a fixed point 
of the two-sided termination of (0. 



A. Tighter Estimates for Spatially Discrete Systems 

It turns out that with we can obtain tighter bounds on 
conditions for fixed points in the spatially discrete case under 
some regularity assumptions on hf and h g . In particular we 
have the following bound 

Theorem 9: Assume hf,h g are C 2 functions. Let /, g be a 
fixed point solution to (0. Then 



\A{h f ,h g )\<\{\\h% 



KIUIMILa 2 



The proof can be found in appendix iBl 

We conjecture that for smooth hf,h g a bound exponential 
in A holds. 

III. Examples of 1-D Systems 

A. Binary Erasure Channel 

Let us start by re-deriving a proof that for transmission 
over the BEC regular spatially-coupled ensembles achieve the 
MAP threshold of the underlying ensemble. By keeping the 
rate fixed and by increasing the degrees it then follows that 
one can achieve capacity this way. This was first shown in [6|. 
Given the current framework, this can be accomplished in a 
few lines. Before we prove this let us see a few more examples. 
We have already seen the corresponding EXIT charts for the 
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Fig. 4. EXIT charts for the (4, 8)-regular (left) and the (5, 10)-regular (right) 
degree distributions and transmission over the BEC. The respective coupled 
thresholds are C pled (4,8) ■■ 



0.497741, and i w (5, 10) = 0.499486. 



(3, 6)-regular case in Figure [2] Figure |4] shows two more ex- 
amples, namely the (4, 8)-regular as well as the (5, 10)-regular 
case. Numerically, the thresholds are e^ p upled (3, 6) = 0.48814, 
Cpw( 4 » 8 ) = 0.497741, and e^ plod (5, 10) = 0.499486. As we 
see these thresholds quickly approach the Shannon limit of 
one-half. 

Consider now a degree distribution pair (A,/?). The BP 
threshold of the uncoupled system is determined by the 
maximum channel parameter e so that e\(x) < 1~ p~ 1 (l — x) 
for all x G (0, 1]. Therefore, dividing both sides by A(a;) we 
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get for each x G (0, 1] an upper bound on the BP threshold. 
In other words, the BP threshold of the uncoupled ensemble 
can be characterized as 



BP • £ 

^uncoupled _ ,„ _ . 

" a:e(0,l] 



x) 



\{x) 



The limiting spatially coupled threshold (when L and w tend 
to infinity) can be characterized in a similar way. In this case 
the determining quantity is the area enclosed by the curves. 
Therefore, 



mplcd 



inf 

2:6(0,1] 



/"l-p-^l-ujdu 



Jo Hu)du 

In the case where the BP threshold equals p7oTy7I) , i-e-, when 
the threshold equals the stability threshold, then the spatially 
coupled threshold equals the BP threshold. 
In the regular case and in many other cases 



luplcd 



jf l-p-\l-u)du 



where x* corresponds to the forward BP fixed point with 
channel parameter e touplod . In this case one can check that the 
threshold is exactly equal to the area threshold. Further, we 
already know that the area threshold is an upper bound on the 
MAP threshold of the underlying ensemble and we know that 
the MAP threshold of the underlying system is equal to the 
MAP threshold of the coupled system when L tends to infinity. 
We therefore conclude that for all such underlying ensembles 
where the area threshold satisfies the strictly positive gap 
condition, the area threshold equals the MAP threshold. 

Our current framework can also be adapted to more 
complicated cases. The following example is from [23 
Fig. 4.15]. Consider the degree distribution (X(x) = 
3x+3x 2 + 14x , p(x) — x 15 ). The left picture in Figure \5\ shows 
the BP EXIT curve of the whole code. As one can see, 
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Fig. 5. BP EXIT curves for the ensemble (X(x) 



3g+3x_+14gf 
20 



,P(z) 



x 5 ) and transmission over the BEC. Left: Determination of the BP threshold. 
Right: Determination of MAP behavior as conjectured by the Maxwell 
construction. 



the BP threshold of the uncoupled ensemble in this case is 
ejU™ = 0.3531 and the BP EXIT curve has a single jump. 

The right picture shows the MAP EXIT curve according to 
the Maxwell construction, see 11241 Section 3.20]. According 
to this construction, the MAP EXIT curve has two jumps, 
namely at e — 0.403174, the conjectured MAP threshold, and 
at e = 0.4855. These two thresholds are determined by local 



balances of areas. This is in particular easy to see for the 
threshold at e = 0.4855, where the two areas are quite large. 

Let us now show that for the coupled ensemble the Maxwell 
conjecture is indeed correct, i.e., we show that the asymptotic 
(in the coupling length L) BP EXIT curve for the spatially- 
coupled ensemble indeed looks as shown in the right-hand 
side of Figure To show that the Maxwell conjecture is also 
correct for the uncoupled system requires a second step which 
we do not address here. This second step consists in showing 
that the MAP behavior of the uncoupled and coupled system 
is identical and is typical accomplished by using the so called 
"interpolation" technique. 

The left picture in Figure |6] shows the individual EXIT 
curves according to our framework for e = 0.4855. For this 
channel parameter the two EXIT curves cross four times, 
namely for u = 0, u = 0.824784, u = 0.967733, and 
u = 0.999952. Note that for this channel parameter the curves 
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Fig. 6. Confirmation of the Maxwell conjecture using the one- 
dimensional framework of spatial coupling for the ensemble (X(x) = 
3x+3x 2 + 14x — ,p(x) = x 15 ) and transmission over the BEC. The two inlets 
show in a magnified way the behavior of the curves inside the two gray boxes. 



do not fulfill the positive gap condition since initially the curve 
eX(u) is above the curve 1 — p(l — v). Nevertheless we can 
use our formalism. Let us explain the idea informally. Let us 
first check the behavior of the system for e = 0.4855. Let 
us shift both curves and renormalize them in such a way that 
first (from the left) non-trivial FP is mapped to zero and the 
last FP (on the right) is mapped to one. Then these curves do 
fulfill the our conditions and our theory applies. This shows 
that once the channel parameter has reached slightly below 
0.4855, the EXIT function drops as indicated in the righ-hand 
side of Figure [5] 

Now where we know what the curve looks like above e = 
0.4855 we can look at the remaining part. The right picture 
in Figure |6] shows the individual EXIT curves according to 
our framework for e = 0.4032. Again, we can redefine our 
curves above this parameter and reparametrize and then they 
do fulfill the positive gap condition. So this marks the second 
threshold. The inlet shows the curve magnified by 1.5 and 15 
respectively. From this we see that the curves are quite well 
matched, so the areas are not so easy to see. 

B. Hard-Decision Decoding 

Low-dimensional descriptions appear naturally when we in- 
vestigate the performance of quantized decoders. The perhaps 



10 



simplest case is the Gallager decoder A, [25 1 (see [26 1 for 
an in-depth discussion). All messages in this case are from 
{±1}. The initial message sent out by the variable nodes is 
the received message. At a check node, the outgoing message 
is the product of the incoming messages. At variable nodes, the 
outgoing message is the received message unless all incoming 
messages agree, in which case we forward this incoming 
message. 

Let x^\ I 6 N, be the state of the decoder, namely the 
fraction of "— l"-messages sent out by the variable nodes in 
iteration I. We have x^' = e, and for I > 1, the DE equations 
read 

1 - p(l - 2x^~ 1 )) 



I) 



e (l-A(l-^))) + (l-e)A(yW) 



Since the state of this system is a scalar, our theory can be 
applied directly. Unfortunately, as discussed in [27 1, for most 
(good) degree-distributions the threshold under the Gallager 
A algorithm is determined by the behavior either at the very 
beginning of the decoding process or at the very end. In neither 
of those cases does spatial coupling improve the threshold. 
In more detail, consider Figure [7] The left picture shows 
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Fig. 7. Left: EXIT charts for the (4, 8)-regular degree distribution under 
the Gallager algorithm A with €°^ p = 0.0476. The curves do not cross. 
The threshold is determined by the stability condition. Right: EXIT charts 
for the (3, 6)-regular degree distribution under the Gallager algorithm A with 
e un'™ P = 0.0395. The threshold is determined by the behavior at the start of 
the algorithm. 

the two EXIT functions for the (4, 8)-regular ensemble under 
the Gallager algorithm A and e™* = 0.0476. As one can see 
from this picture, this is the threshold for the uncoupled case. 
This threshold is determined by the stability condition, i.e., 
the behavior of the decoder towards the end of the decoding 
process. In other words, the functions h g (v) and the inverse of 
h f (u) have the same derivative at 0. If we increase the channel 
parameter then the resulting EXIT curves no longer fulfill the 
positive gap condition (since they cross already at 0). This 
implies that the threshold of the spatially coupled ensemble is 
the same as for the uncoupled one. 

The right picture in Figure [7] shows the two EXIT functions 
for the (3, 6)-regular ensemble under the Gallager algorithm 
A and e = 0.0395, the threshold for the uncoupled case. 
In this case the threshold is determined by the behavior at 
the beginning of the decoding process. As one can see from 
the picture, there are two non-zero FPs. The "smaller" one is 
unstable and the "larger" one is stable. If the initial state of 



the system is below the small FP then the decoder converges 
to 0, i.e., it succeeds. But if it starts above the small FP, then 
the decoder converges to the large and stable non-zero FP, 
i.e., it fails. As one can see from the picture, already for the 
channel parameter which corresponds to the threshold of the 
uncoupled these two EXIT curves do not fulfill the positive 
gap condition - the total area enclosed by the two curves is 
negative. And if we increase the channel parameter, the area 
would become even more negative. Hence, also in this case 
spatial coupling does not help. 

Let us therefore consider the Gallager algorithm B, ll25ll . 
[26 1 . As for the Gallager algorithm A, all messages are from 
the set {±1}. The initial message and the message-passing rule 
at the check nodes are identical. But at variable nodes we have 
a parameter b, an integer. If at least b of the incoming messages 
agree, then we send this value, otherwise we send the received 
value. This threshold b can be a function of time. Initially the 
internal messages are quite unreliable. Therefore, b should be 
chosen large in this stage (if we choose b to be the degree 
of the node minus one we recover the Gallager algorithm A). 
But as time goes on, the internal messages become more and 
more reliable and a simple majority of the internal nodes will 
be appropriate. The DE equations for this case are 



M - 



l-p(l-2x^- 1 )) 



di-l 



M - 



=(l-e)£ 



k=b 
dj-1 



d \ 1 )<.'/"' A d-.'/"' ,if - 1 
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Assume at first that we keep b constant over time. Consider the 
(4, 10)-regular ensemble and choose b — 3. The left picture 
in Figure [8] shows this example for e°" p = 0.02454. As we 
can see, this is the largest channel parameter for which the two 
curves do not cross, i.e., this is the threshold for the uncoupled 
case. The right picture in Figure [8] shows the same example 
but for e^ U p = 0.0333. For this channel parameter the strictly 
positive gap condition is fulfilled and the two areas are exactly 
in balance, i.e., this is the threshold for the coupled ensemble. 
We see that the increase in the threshold is substantial for this 
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Fig. 8. Left: EXIT charts for the the (4, 10)-regular ensemble and the 
Gallager algorithm B with 6 = 3 and eJJcmp = 0.02454. The curves do not 
cross. Right: The same example but with e™jS = 0.0333. For this channel 
parameter the positive gap condition is fulfilled and the two areas are in 
balance. In both cases, the inlets show a magnified version of the gray box. 
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We can do even better if we allow b to vary as a function of 
the state of the system. The optimum choice of b as a function 
of the state x was already determined by Gallager and we have 

r , log 1=* \ "1 

6 ( £ ^ = Kdyi + ( d ''- 1 ))/ 2 ■ 

Assume that at any point we pick the optimum b value. For the 
EXIT charts this corresponds to looking at the minimum of 
the EXIT chart at the variable node over all admissible values 
of b. If we apply this to the (4, 10)-regular ensemble then we 
get a threshold of ecoup° P '(4, 8) = 0.04085, another marked im- 
provement. As a second example, consider the (6, 12)-regular 
ensemble. For this ensemble no fixed-6 decoding strategy 
improves the threshold under spatial coupling compared to 
the uncoupled case. But if we admit an optimization over b 
then we get a substantially improved threshold, namely the 
threshold is now e^ B,opl (6, 12) = 0.0555. For comparison, 
e°" B (6,12) = 0.034L 

Discussion: The optimum strategy assumes that at the 
decoder we know at each iteration (at at each position if we 
consider spatially coupled ensembles) the current state of the 
system. Whether or not this is realistic depends somewhat on 
the circumstances. For very large codes the evolution of the 
state is well predicted by DE and can hence be determined 
once and for all. For smaller systems the evolution shows more 
variation. One option is to measure e.g. the number unsatisfied 
check nodes given the current decisions and to estimate from 
this the state. 

IV. Higher-Dimensional Systems and the Gaussian 
Approximation 

We have discussed in the previous section several scenarios 
where the state of the system is one dimensional and the 
developed theory can be applied directly and gives precise 
predictions on the threshold of coupled systems. But we can 
considerably expand the field of applications if we are content 
with approximations. For uncoupled systems a good example 
is the use of EXIT functions. EXIT functions are equivalent 
to DE for the case of the BEC, where the state is indeed one 
dimensional. For transmission over general BMS channels they 
are no longer exact but they are very useful engineering tools 
which give accurate predictions and valuable insight into the 
behavior of the system. 

The idea of EXIT functions is to replace the unknown 
message densities appearing in DE by Gaussian densities. If 
one assumes that the densities are symmetric (all densities 
appearing in DE are symmetric) then each Gaussian density 
has only a single degree of freedom and we are back to 
a one-dimensional system. Clearly, the same approach can 
be applied to coupled systems. Let us now discuss several 
concrete examples. We start with transmission over general 
BMS channels. 

A. Coding and Transmission over General Channels 

As we have just discussed, for transmission over general 
BMS channels it is natural to use EXIT charts as a one- 
dimensional approximation of the DE process 1281 . |29| , 11301 . 



I3TI . This strategy has been used successfully in a wide array 
of settings to approximately predict the performance of the 
BP decoder. As we have seen, whereas for the BP decoder 
the criterion of success is that the two EXIT curves do not 
overlap, for the performance of spatially coupled systems the 
criterion is the positive gap condition and the area condition. 

We demonstrate the basic technique by considering the 
simple setting of point-to-point transmission using irregular 
LDPC ensembles. It is understood that the same ideas can be 
applied to any of the many other scenarios where EXIT charts 
have been used to predict the performance of the BP decoder 
of uncoupled systems. 

In the sequel, let ip(m) denote the function which gives the 
entropy of a symmetric Gaussian of mean m (and therefore 
standard variation a = y/2/m). Although there is no elemen- 
tary expression for this function, there are a variety of efficient 
numerical methods to determine its value, see ll24l . 

Define the two functions 

hg{v) =1- Ih*" 1 (!-«)), 
i 

h f { u ) = aw>((i - i)ir x («) + 

i 

Note that h g (v) describes the entropy at the output of a check 
node assuming that the input entropy is equal to v and h t (u) 
describes the entropy at the output of a variable node assuming 
that the input entropy is equal to u and that the entropy 
of the channel is c. Both of these functions are computed 
under the assumption that all incoming densities are symmetric 
Gaussians (with the corresponding entropy). In addition, for 
the computation of the function h g (v) we have used the so- 
called "dual" approximation, see ll24l p. 236]. 

Fig.|9]plots the EXIT charts for the (3, 6)-regular ensemble 
and transmission over the BAWGNC. The plot on the left 
shows the determination of the BP threshold for the uncoupled 
system according to the EXIT chart paradigm. The threshold 
is determined by the largest channel parameter so that the 
two curves do not cross. This parameter is equal to h BP ' EXIT = 
0.42915. Note that according to DE the BP threshold is equal 
to h Be = 0.4293, see |24] Table 4.115 ], a good match. 

The plot on the right show the determination of the BP 
threshold for the coupled ensemble according to the positive 
gap condition. Since for this case we only have a single 
nontrivial FP, this threshold is given by the maximum channel 
entropy so that the gap for the largest FP is equal to 0. This 
means, that for this channel parameter the "white" and the 
"dark gray" area are equally large. This parameter is equal to 
0.4758. Note that according to DE, the BP threshold 

0.4794, see Qol 



hi pled 



of the coupled system is equal to hJJJ^, 
Table II], again a good match. 

B. Min-Sum Decoder 

As a second application let us consider the min-sum de- 
coder. The message-passing rule at the variable nodes is 
identical to the one used for the BP decoder. But at a check 
nodes the rule differs - for the min-sum decoder the sign of the 
output is the product of the signs of the incoming messages 
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Fig. 9. Left: Determination of the BP threshold according to the EXIT 

chart paradigm for the (3, 6)-regular ensemble and transmission over the 

BAWGNC. The two curves are shown for h BP > EXIT = 0.42915. As one 

can see from this picture, the two curves touch but do not cross. Right: 

Determination of the BP threshold for the coupled ensemble according to 

the EXIT chart paradigm and the positive gap condition. The two curves are 
bp exit 

shown for h coll ' plL . d = 0.4758. For this parameter the "white" and the "dark 
gray" area are in balance. 
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Fig. 10. Left: Determination of the MinSum threshold according to the 
EXIT chart paradigm for the (3, 6)-regular ensemble and transmission over the 
BAWGNC. The two curves are shown for h BP ' EXIT = 0.401. As one can see 
from this picture, the two curves touch but do not cross. Right: Determination 
of the MinSum threshold for the coupled ensemble according to the EXIT 
chart paradigm and the positive gap condition. The two curves are shown for 
h™'^"™'™ 1 = 0-436. For this parameter the "white" and the "dark gTay" area 
are in balance. 
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(just like for the BP decoder) but the absolute value of the 
outgoing message is the minimum of the absolute values of 
the incoming messages. 

For, e.g., the (3, 6)-regular ensemble DE predicts a min-sum 
decoding threshold on the BAWGNC of h M '" Sum = 0.381787, 
[32 1 . For the coupled case this threshold jumps to h^jf™ = 
0.4290 

In order to derive a one-dimensional representation of DE , 
we restrict the class of densities to symmetric Gaussians. Of 
course, this introduces some error. Contrary to BP decoding, 
the messages appearing in the min-sum decoding are not in 
general symmetric (and neither are they Gaussian). 

The DE rule at variable nodes is identical to the one used 
when we modeled the BP decoder. The DE rule for the check 
nodes is more difficult to model but it is easy to compute 
numerically. 

Rather than plotting EXIT charts using entropy, we use the 
error as our basic parameter. There are two reasons for this 
choice. First, our one-dimensional theory does not depend on 
the choice of parameters and so it is instructive see an example 
which uses a parameter other than entropy. Second, the min- 
sum decoder is inherently invariant to a scaling, whereas 
entropy is quite sensitive to such a scaling. Error probability 
on the other hand is also invariant to scaling. 

Figure [10] shows the predictions we get by applying our one- 
dimensional model. The predicted thresholds are h"^"™ ' EXIT = 
0.401, h"'r p M ,EXIT = 0.436. These predictions are less accurate 
than the equivalent predictions for the BP decoder. Most likely 
this is due to the lack of symmetry of the min-sum decoder. 
But the predictions still show the right qualitative behavior. 

V. Analysis and Proofs 

In our analysis we admit discontinuous update functions. 
This is not only for generality but for modeling of termination. 
We need some notation for dealing with this. 

2 Strictly speaking it is not known that min-sum has a threshold, i.e., that 
there exists a channel parameter so that for all better channels the decoder 
converges with high probability in the large system limit and that for all worse 
channels it does not. Nevertheless, one can numerically compute "thresholds" 
and check empirically that indeed they behave in the expected way. 



Given a monotonically non-decreasing function / we write 

v = f(u) 

to mean v £ [f(u-),f(u+)]. Given g £ *(_oo,+oo), contin- 
uous / £ ^(-oo.+oo), an d h £ ^[0,1] we write 

g^hof 

to mean g[x) £ [h(f(x)-),h(f{x)+)}, i.e., g(x) = h(J(x)), 
for all We write 

9 = ho f 

to mean g{x) — h(f(x)) for all x. In some contexts we may 
relax this to require only that equality hold up to a set of x 
of measure 0. In such a context it should be understood that 
we can modify g on a set of measure zero so that the equality 
holds everywhere. Moreover, modifying g on a set of measure 
has no impact on g u . 

Ultimately we are interested in solutions such that g = h g o 
f u , and / = hf o g u >* , since this represents a solution to 
system [3] 

A. Monotonicity of <fi. 

Lemma 6: Let hf,h g £ ^[0,1] ■ If we nave ( u ,v) £ [0, l] 2 
such that v < hf(u—) and u < h g (v—), then there exists a 
minimal element (u*,v*) £ x(hf,h g ) with (u*,v*) > (u,v) 
(component-wise) and we have (f>(u* , v*) < 4>{u, v). Similarly, 
if (u,v) satisfies v > hf(u+) and u > h g (v+), then 
there exists a maximal element (u*,v*) £ x(hf,h g ), with 
(u*,v*) < (u,v) (component-wise) and we have (j>(u*,v*) < 
<j){u,v). 

Proof: We show the first case, the other case is analogous. 
Since v < hf(u—) and u < h g (v—) we have h~ 1 (u+) < v < 
hf(u—) and we cannot have a crossing (u',v r ) with either 
u' = u or v' = v. Since x{hf> h g ) is closed we see that (u, 1] x 
(v, 1] C\x(hf, h g ) is closed. By Lemma [T]x( hf, h g ) is ordered 
so there exists a minimal element (u*,v*) in (u, 1] x (v, 1] n 
x(hf,h g ). Set (u°,v°) — (u,v) and consider the sequence 
of points (u°,v°), (u ,^ 1 ), (u 1 ,^ 1 ), (u 1 ,?; 2 ), (u 2 ,v 2 ), . . . as 
determined by ([T). It follows easily from ([T]) that this sequence 
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is non-decreasing. If it* < u* and u* < v* for all i then 
the sequence must converge to (u*,v*) since the limit is 
in x(hf,h g ) by continuity and (u*,v*) is minimal. It then 
follows by continuity of (f>(hf, h g ; ) and Lemma [3] that 

<p{h f ,h g ;u*,v*) < <p(h f ,h g ;u° ^v 1 ) < <j)(hf,h g ;u°,v ). 

Assume now that u* = u* for some t. Then t > and Lemma 
E] gives 

<f>(h f ,h g ;u*,v*) = <j){h f ,h g - 1 u t 1 v t+1 ) < <j>(hf,h g ;u°,v°). 

Finally, assume that i?' = v* for some t. Then i > and 
Lemma [3] gives 

0(ft/, h g ;u* ,v*) = <p(hf, ft s ;u*, u*) < </>(ft/, h g ;u° ,v°) . 

This completes the proof. ■ 

Lemma 7: If (ft/, ft 9 ) £ 'J/jp jj satisfies the strictly positive 
gap condition then ft / and h g are continuous at and 1 . 

Proof: Assume (hf,h g ) £ $L, satisfies the strictly 
positive gap condition. Assume ft/(0+) > 0, we will 
obtain a contradiction. We have (0,v) £ x{hf,h g ) an d 
(f>(h f ,h g ;0,v) = for all u e [0, min{ft- 1 (0+), ft/(0+)}], 
hence h~ 1 (0+) — 0. This implies that there are no non-trivial 
crossing points (u, v) with u = or with v = 0. It follows 
that xihf,h g ) n ((0,1] x (0,1]) is closed. Since x°(hf,h g ) 
is non empty there is a positive minimal element (u*,v*) in 
X°(hf,h g ). Note that we must have u* > ft/(0+). 

Choose < u < u* sufficiently small so that hj 1 (u+) < 
ft/(0+) and v so that h~ 1 (u+) < v < ft/(0+). It follows 
that v < hf(u—) and u < h g {v—). By Lemma [6] we have 
<fi(hf,h g ;u*,v*) < <fi(hf,h g ;u,v) < 0, which contradicts 
the strictly positive gap condition. 

Therefore, we must have hf(0+) — 0. All other conditions, 
h g (0+) = 0,hf(l—) = 1, and h g (l— ) = 1 can be shown 
similarly. ■ 

Lemma 8: Let (hf,h g ) € ^ and let (u, v) e [0, l] 2 . We 
then have the following three possibilities. 

• If h g (hf(u)) = u then (u, hf(u)) € x{hf, h g ). 

• If h g (hf(u)) > u then <j>(hf,h g ;u*,v*) < 
4>(hf,h g ;u,v) where (u*,w*) G x (ft./, is coordinate- 
wise minimal with (u*,w*) > (u,hf(u)). 

• If h g (hf(u)) < u then <fi(hf,h g ;u*,v*) < 
4>(hf,h g ;u,v) where 6 x (ft/, ft s ) is coordinate- 
wise maximal with (u*,v*) < (u,hf(u)). 

Proof: If u = h g (hf(u)) then (u, ft/(u)) e x(^/ ; ^g) by 
definition. Thus, the first case holds and the other two hold un- 
der this condition. We assume henceforth that u h g (h g (u)). 
Assuming now h g (hf(u)) > u, we have h g {hf(u) — ) > u. We 
also have h~ 1 (u+) < hf(u). 

Let (u* , v*) £ x(hf, h g ) be the minimal element such that 
(u*,v*) > (u,hf(u)). It follows that u* > u which implies 
v* > hf(u+). For all e > sufficiently small we have u + e < 
hg((hf(u)—e)—) and we obviously have ft/(u) — e < hf((u + 
e)— ). Assuming e sufficiently small (u*,v*) is the minimal 
element in x(ft/,ft g ) with (u*,v*) > (u + e,ft/(u) — e) and 
by Lemma|6]we have (f>(u* , v*) < <fi(u + e, hf(u) — e). Letting 
e tend to we obtain <p(u*,v*) < <fi(u, hf(u)). 



The argument for the case ft g (ft/(u)) < u is similar and 
we omit it. ■ 

Lemma 9: Let (ft/,ft g ) £ fy? ^ satisfy the strictly positive 
gap condition. If A(hf,h g ) > then <fi(hf,h g ;u,v) > for 
(u,v) £ [0,1] 2 \{(0,0), (1,1)}. If A(hf,h g ) > then there 
exists a minimal point (u* , v*) £ x°(hf, h g ) and 

S(hf,h g ) = {(u,v) : 4>(h f ,h g ;u,v) < A(h f ,h g )} 

is simply connected and S(hf,h g ) C [0, u*) x [0, u*). More- 
over, 

{(«,«) : 4>(hf,h g ;u,v) < A(hf,h B )} = S^hgj\J{0.,l)}. 

Proof: Assume (hf,h g ) £ 1 , satisfies the strictly 
positive gap condition and that A(hf, h g ) > 0. It follows from 
Lemma 2] that if there exists (u,v) with cf>{hf,h g ;u,v) < 
then there exists (u,f) G x(hf,h g ) with <f>(hf ,h g ;u,v) < 
0, hence, (f>(hf,h g ;) > 0. Lemma H] now further implies 
that if there exists (u, v) with c/)(hf,h g ;u,v) = then 
(w, u) £ x{hf,h g ). Thus, we have 0(ft/ , h g ;u,v) > for 
(«,«) ^{(0,0), (1,1)}. 

Assume now that A(hf,h g ) > 0. Let (u*,v*) be the 
infimum of x°(hf,h g ). Then (it*,v*) G x(hf,h g ) and 
since tp(hf,h g ;u,v) is continuous in u,t> we cannot have 
(u*,v*) = (0,0) and therefore (u*,v*) £ x°(hf,h g ). By 
Lemma |7] we also have u* > and t>* > 0. 

Let (u,v) £ S(hf,h g ) and assume that ti^O and t? 7^ 0. 
By Lemma [3] and Lemma [8] we see that we must have 
h g (hf(u)) < u. Setting (u ,!; 1 ) = (u,hf(u)) then the se- 
quence of points (u°, v 1 ), (u 1 , v 1 ), (u , v 2 ), (u 2 , v 2 ), ... as de- 
termined by (Q]l are coordinate-wise non-increasing and must 
converge to (0, 0). Furthermore, by Lemma[3] (coordinate-wise 
convexity) the line segments joining successive points are all 
in S(hf,h g ). In addition, the line segment joining (u,v) to 
(u,hf(u)) is also in S(hf,h g ). Thus, S(hf,h g ) is simply 
connected. 

Assume there exists (u,v) £ S(hf,h g ) with u > u* , 
and, consequently, v* < hf(u). Then, by Lemma [3] we have 
(u,hf(u)) £ S(hf,h g ). Lemma[8]now implies the existence 
of (u',v r ) > (u*,v*) with <p(hf,h g ;u',v') < A(h f ,h g ) 
which contradicts the strictly positive gap condition. Hence 
S(hf,h g ) C [0,u*) x [0,v*). Furthermore, Lemma [3] implies 
that 4>(hf,h g ;u*,v) > A(hf,h g ) for all v £ [0,1] and 
(j)[hf, h g ;u, v*) > A(hf,h g ) for all u £ [0, 1] so S(hf,h g ) C 
[0,u*)x[0,«*). 

Assume there exists (u,v) £" S(hf,h g ) U {(1,1)} with 
<fi(hf,h g ;u,v) — A(hf,h g ). Then (u,v) is a local minimum 
of <fi(hf,h g ;u,v) which, by Lemma HI implies (u, v) £ 
x(hf, h g ), contradicting the strictly positive gap condition. ■ 

B. Spatial Fixed Points and Waves 

Even when one exists, it is difficult to analytically deter- 
mine an interpolating spatial fixed point solution (/, g) £ 

*(-oo,+oo) for a S iven P air ( h 9' h f) e *[o,i]- The reverse 
direction, however, is relatively easy. In particular, given a 
putative interpolating spatial fixed point (/, g) the correspond- 
ing (hf,h g ) is essentially determined by the requirement that 

g(x) = h g (f u} {x)) and f(x) = hf(g u) (x)). Some degeneracy 
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is possible if, for example, f u is constant over some interval 
on which g varies. Even in this degenerate case the equivalence 
class of h g is uniquely determined. Thus, given interpolating 
/ and g where / is continuous, we define higji to be any 
element of the equivalence class such that, 

.9 =?= h [gJ] o / 

i.e., for each x, g(x) G [h [gJ] (f(x)-),h [gJ] (f(x)+)}. (An 
easy exercise shows that the equivalence class is uniquely 
determined.) 

If (/, g) is an interpolating spatial fixed point solution to 
(0 then we have hifg*] = hf and hi g j^ — h g . In the 
reverse direction, hit gu] = hf and hi g jui = h g implies, and, 
(assuming / and g are interpolating) is in fact equivalent to, 

9 = h g or, f=h f og» 

but does not imply 

g=h g or, f = hf OS r. 

A significant part of the paper is devoted to distinguishing 
between these cases. 

Similarly, if /, g is a spatial wave solution with shift s then 

h[f,g«>,*] = h f and h [g>M = h g . 

1 ) Some Pathological Examples: Let us define 

!0 x < 
a x = 
1 x > 

In many cases the value of a is immaterial and we will drop 
the subscript from the notation. 

The following example shows that changing /ij or /i s on a 
set of measure can, for some choices of ui, have a dramatic 
effect on the solution to ||3}. Consider an averaging kernel ui 
that is positive everywhere on K except on [—2,2], where it 
equals 0. Set 

hf(u) =H (u- -). 

and 

h g (u) = Hb(u- -)■ 

Let f(x) = H(x), then we have we have f u (x) < \ for 
x G (oo, -2), f u (x) = \ for x G [-2,2], and f u {x) > \ for 
x G (2, oo) . Consider initializing f°(x) = H(x) in system 
d3j. If a = 6 = i then the solution is the fixed point 

f(x) = g\x) = i(H x (a: + 2) + H (z - 2)) . 

If a = b = 1 then the solution is 

f(x) =Hi(x-4t) 
g t (x)=U 1 (x-4t-2), 

and f t (x) — > 0. If a = b = then the solution is 



and /*(&) — > 1. If a = and 6=1 then the solution is 

/*(a;) = H (x) 
5 t (^)=H 1 (x-2), 

and we have a fixed point. 

To give a more general example, if we define / and g as 
any functions in ^(_oo,+oo) mat equal on (— oo, —1) and 
1 on (1, +oo) then we have g = h g o f u and / = hf o g UJ 1 
hence, it follows that hif^i — hf and hi g jui — h g up to a 
set of measure 0. This example shows that it is possible to 
have many solutions that are "consistent" with the equation 
(0, in that g = h g o f u and / = hfog u . We also observe that 
solutions with g = h g o f u and / = hf o g u can have great 
sensitivity to changes in hf and h g at points of discontinuity. 

Now assume lo — ^ 1 1 ^ i <- ^ - Let / snd g be any functions in 
^(-oo +oo) that equal on (— oo, — 1) and 1 on (l,+oo) and 
take values in (0, 1) on (—1,1). Now consider 

fa(x) = \(f(x + a) + f(x-a)) 

9a{x) = - (g{x + a)+g(x- a)) 

Then we see that for all a > 3 (h\f g*>], hig a ,f«>]) does not 
depend on a and the given functions form a family of spatial 
fixed points for the system. This gives an example where 
system (Q]) exhibits multiple spatial fixed point solutions. We 
remark that (hif a , g u], hi ga ju]) does not satisfy the strictly 
positive gap condition since (j>(h\f a g<*u hi gat fuy, |, |) = 0. 

C. Spatial fixed point integration. 

Consider an interpolating spatial fixed point (/, g). Then, at 
v = f w (zi) the integral L h g , which appears in the definition 
of $, can be expressed as 

J\ g (x)dx = J" 1 g(z)(^r(z))dz = j\{z)&r{z). 
Similarly, at u = g^iz-i) we have 

/ h f (x)dx= / f(z)dg"(z). 

JO J -co 

Note that, under mild regularity assumptions, g(z)df(z) + 
f(z)dg(z) = d(g(z)f(z)) and that, were it not for the 
spatial smoothing, we could solve directly the sum of the 
above two integrals in terms of the product g{z)f(z). By 
properly handling the spatial smoothing we can accomplish 
something similar, and the result is presented in Lemma 
[TOl We obtain a succinct formula for the evaluation of 
$(h f ,h g ; g UJ (z 2 ), f u {zi)) and for </>(h f ,h g j f(z 2 ),g(z 1 )) that 
is local in its dependence on / and g. This formula captures 
a large amount of information concerning the interpolating 
spatial fixed point solution and its relation to $ and <p. 

Let (/, g) G ^(-oo +oo) an d let ui be an even averaging 
kernel. Define 



f t (x) = U (x + At) 
g t (x)=n (x + 4t + 2), 



£(cj; f,g; x x ,x 2 ) := {f u {x x ) - f(x 2 ))(g u (x 2 ) - g( Xl )) 

+ T(w; f,g;x!,x 2 ) (11) 
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where 

T{uj;f,g;xi,x 2 ) 
;(*)( 

;(*)( 

w(x) 



w W I / (ffOi) - 3(y - x))df(y) ) 

-•(•'')( / (f(x2) - f(y - x))dg{y) )dx 

11 X J(x 1 ,x 2 +x] 



(.9(^1) - 9(y -x))df(y))dx 

l(x 2 ,x 1 +x] 

>(*)(/ (f(x 2 )-f(y-x))dg(y))dx 

y J(x!,X 2 +x] ' 

where the integrals are Lebesgue-Stieltjes integrals. If x' < x 
the S(x,x>] f(y) d 9(v) is defined to be - j (x , x] f{y)dg(y). Note 
that this shows that T is non-negative. We show in the proof of 
the following Lemma that the three forms for T are equivalent. 

Lemma 10: If /, g G ^(-00, +00) an d w is an even averaging 
kernel, then 

r(x 1 )g u {x 2 )-r(- (X> )g u (-o ) 

h[f t gu,](u)du - / h[gju,](v)dv 
£{u;f,g;x 1 ,x 2 ) 



and 



/(*2) rg(xi) 
f(-oo) J g{-oo) 

- {f{x 2 )g{xi) - /(-oo)g(-oo)) 
= T(uj;f,g;x 1 ,x 2 ) 
for all x\ and x 2 . 

The proof of this key lemma can be found in appendix [A] 

A consequence of Lemma [10] is that if (/, g) are interpo- 
lating and (h f ,h g ) = % r] ,ft[ 9 j U ]), then 

${h f ,h g ; g"(x 2 ), / w (a;i)) = £(w; f,g\ x u x 2 ) 
and 

<t>(hf,h g ; f{x 2 ), g{xi)) = T(uj; f, g; x x , x 2 ) 

for all x\ and x 2 . 

Let us introduce the notation 

A L f(x) = f((x + L)-)-f((x-L)+) 

and the quantity = f L u>(x)dx . The following bounds are 
proved in appendix lAl 

Lemma 11: Let /, g be functions in ^(-oo.+oo)- F° r anv 
L > we have the following inequalities 

T(w, f, g; x, x) < A L f(x)A L g(x) + e L 

\r(x)-f(x)\<A L f(x) + e L 
This Lemma implies that for interpolating /, g G ^(-oo.+oo) 

$(h lfig „,* h h lg j u] ;g"(x),f u (x)) < 2A L f(x)A L g(x)+4e L 
$(h [f!gU ,, h h [gJU] -,g u '(x)J(x))<3A L f(x) + 5e L 
Hh[f, g ^], h [g>M ■ g{x), r{x)) < 3A L g(x) + be L 



and 



(t>(h lfig u 1 ,„ ] ,h lg j^ ] ;f(x),g(x)) < A L f(x)A L g(x) + e L 
4>(h[f, g ^],h [gtn ;f(x),g u (x)) < 2A L g(x) + 2e L 
4>(h [ftg «,, s] ,h [gtn ;f"(x),g(x)) < 2A L f(x) + 2e L 

1) Transition length.: In this section our aim is to show 
that fixed point solutions arising from systems satisfying the 
strictly positive gap condition have bounded transition regions. 
We show that the transition of solutions from one value to 
another is confined to a region whose width can be bound 
from above using properties of $ 

Lemma 12: Let f,g be interpolating functions in 



(— 00, +00) • 



Let hf = h 



[/,<?* 



and h g = 7ir fl ,/">i- Let 



< a < b < 1 and assume g u (x) G [a, b] for x G [x a ,Xb] 
Define S = inf {(f>(hf, h g ; g^ix), f(x)) : x G [x a ,Xb]} then 



Xb 



2L 



<(h f (g»(x b ))-h f (g"(x a ))) 



Proof: For any x G [x a ,Xb] we have AlJ(x) > 
Al5(x)Al/(x) > S — 6l by Lemma [TT] In the interval 
[x a ,a;b] we can find \ Xb 2^ a J non-overlapping intervals of 
length 2L. Hence h f (g u (x b )) - h f (g u (x a )) = f(x b ) - 
f(x a )>[^\(S-e L ) M 
2) Discrete Spatial Integration: Perhaps somewhat surpris- 
ingly, a version of Lemma [TOl that applies to spatially discrete 
systems also holds. If /, g as spatially discrete functions and 
/, g are their piecewise constant extensions, then Lemma [10] 
can be applied to these extensions. If we then restrict x\ and 
x 2 to points in AZ, then £ and T can be written as discrete 
sums. 

Let w be related to ui as in ((HJl and let xi,x 2 G AZ, denoted 
Xi,i,Xi t2 . Then 

€(u;f,g; x it i,x if2 ) 

= (fn - fi 3 )(9i 3 ~9ii) +T(u;f,g;x il ,Xi 2 ) 

and 

T{uj;f,g; x n ,x t2 ) 
1 W 

= 2 Y Wj Y ~fi~ fi-l)(j9i+3 ~ 9i+j-\) 

j=—W ie(ii—j,K] 

1 w 

= o W J ( 2 9h ~ 9i ~ 9i-i)(fi+j ~ fi+j-i) 

j=-W ie(i a -j,ii] 

Lemma [10] continues to hold and a proof using entirely 
discrete summation can be found in appendix |B1 

Discussion: The proof of Lemma [TOl as well as the spatially 
discrete version found in append [B] are entirely algebraic 
in character. Consequently they apply not only to spatially 
coupled systems with one dimensional state but much more 
generally. In a forthcoming paper we apply the result to the 
arbitrary binary memoryless symmetric channel case to obtain 
a new proof that spatially coupled regular ensembles achieve 
capacity universally on such channels. 
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D. Necessary conditions on interpolating spatial fixed points. 

1 ) Positive gap condition: The result from the previous sec- 
tion gives rise to many constraints on interpolating spatial fixed 
points and their associated functions (hf,h g ). In particular, it 
is the origin of the positive gap condition. 

Lemma 13: Let (/, g) £ +oc ) be interpolating func- 

tions and let uj be an averaging kernel. Then (h^f h[ g j^) 
satisfies the positive gap condition and A(hy^ g u,^ h^ g j^) = 0. 

Proof: Since T(w; f, g; x\, x 2 ) > for all x\,x 2 
we see from Lemma [TUl that (j)(htf ig ui, hi g j u y, u, v) > 
for all (u,v) £ [0, l] 2 . Letting xi,x 2 — > 00 we see 
T(u; f, g; x±, X2) — > and we obtain A(ht, h g ) = 0. ■ 

E. Bounds on s 

Lemma 14: Let f,g £ ^(-00. +00) be interpolating. Then 

A ( h [f,g">*], h [g,f»]) < MIMU • 
Proof: We have A(/ir/ )S ^i, h\ g ju\) = and 

A i h U,g"-"]' h [aJ"l> = A ( h [f,g"'']' h [aJ'"]) ~ A ( h lf,a u, ]' h laJ"']) 
f 00 

{f{x- S )-f{x))g%{x)dx. 

00 

Since \g%(x)\ < \\u>\\oo we obtain \A{h [f ^. s] ,h [gJ ^)\ < 

WI|w||oo. ■ 

In general this estimate can be weak. In Section IV-B1I 
we gave an example of a system with A(hf,h g ) = and 
irregular cj that can exhibit both left and right moving waves 
by changing the value hf and h g at a point of discontinuity. 
Further, given interpolating /, g and positive cj the system 



( h lf,: 



, h\gju,-a]) (with real parameter a) has a traveling 



solution with shift s and yet A(h\f tj 



]) can be 



made arbitrarily close to by choosing a with large enough 
magnitude. 

Now we consider upper bounds on \s\. Let 



Q(x) 



u(y)dy. 



If ui has compact support then the width of the support is an 
upper bound. Consider a w that is strictly positive on M. Let 
hf(x) = h g {x) = H(x — (1 — e)) for small positive e. A 
traveling wave solution for this system is f l (x) = H(x — ts) 
and g t (x) — H(x — ts—s/2) where s is given by f2(— s/2) = 
(1 — e). This example motivates the following bound. 
Lemma 15: Let /, g £ ^(-oo.+oo) be interpolating and 



let h. 



and h„ 



l {g,f" 



Given (u, v) with 



v < hf(u—) and u < h g (v—) we have the bound 

v \ „ 1 / it 



5 < rr 1 



hf(u-) 



llg(V-) 



and given (u,v) with v > hf(u+) and u > h g (v+) we have 
the bound 



-s < rr 1 



1 



l-h f (u+) 



1 



i-/i 9 0+) 



Proof: We will show the first bound, the second is similar. 
For any x\, x 2 £ M we have 





f(x)(j(xi 


•J — OO 






f(x)u){x x 


J x 2 


r + QO 




) / w 

/•X1 — X2 


f(x2+ 


] ' 
00 



oj(x)dx . 



Thus, we obtain the inequality 



X\ ~ #2 < Q 



f(X2- 



Choose x\ so that f u {x\) — v. Then we have g(xi+) > 
5f(xi) > h g (v—). Choose X2 so that g UJ ' 5 (x 2 ) — g u '(x 2 +s) = 
u. Then we have f(x 2 +) > f(x 2 ) > hf(u—). 
Applying the above inequality we obtain 



Xl -x 2 <n-i(p^ + )<n-i(-^_ ]+ ) 

\f(x2+) > \hf(u-) / 
_ 1 fg u (x 2 +s) \ , / u 



and 

x 2 + s — x\ < O 
Summing, we obtain 



hg(V~) 



Lemma 16: Let (hf,h g ) £ ^ Q ^ satisfy the strictly posi- 
tive gap condition. Then there exists (u,v) with v < hf(u—) 
and u < h g (v~) and (u,v) with v > hf(u+) and u < 

kg{v+). 

Proof: Let G + = {(u, v) : v > hf(u+) and w > 
h g (v+)} and G~ = {(u, v) : v < hf(u—) and u < h g (v—)}. 
Then 

A(h f ,h g ) = f i(G+)-fi(G-) 

where /i(G) denotes the Lebesgue measure of G. There 
exists (x*,y*) £ X°Q l f,h g ) and (f>(hf,h g ;u*,v*) > 
max{0,A(hf,h g )}. Let R = [0,u*\ x [0,v*]. Now 

4>(h f , h g ; u*,v*) = ^(G+ Hi?) - p,{G~ n R) 

hence /i(G + (~1 R) > max{0, A(hf, h g )} and it follows that 
H(G~) > 0. ■ 
Corollary 2: Let f,g £ ^(-oo.+oo) be interpolating. Let 
hf = h\f t ga,*T, and let h g = h\ g juy If (hf,h g ) satisfies the 
strictly positive gap condition and u is regular then s < 2W. 
Proof: This combines Lemma [T5l with Lemma [T6l ■ 
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F. Analysis of Spatial Waves 

For ft G ^[0,1] we use Jh to denote the set of discontinuity 
points of ft, i.e., 

J h = {ue [0, 1] : ft(u-) < /»(«+)}. 

For continuous / G ^(-co.+oo) let 1\f\ denote the set of 
positive-length maximal intervals on which / is constant. 

Let u) be regular and assume 4-f u (x) = at x = x±. Then 
J-W ^(^i — x )df(x) = from which we obtain Ayyf(xi) = 
0. It follows that if f UJ (x) = F (a constant) for x E I where 
7 is an interval of positive length then f(x)=F for all x G 
(I) w , c.f. ©. 

Lemma 17: Let (/, g) be interpolating and let ui be regular. 

Let h f , a = ft s = ft[g,/"] with s > 0. If -£g"(x) = 

or -^f u {x) = at x — z then 

<f>(hf, s ,h g ;g(z),f(z)) G [0, A(ft/ i5 , h g )}. 

Proof: Assume j^g^ix) — at x — z. Then, since uj 
is regular, g(x) = g u (z) for x E ({^})w- Using L = W 
in Lemma [TTI we obtain i>(hf o,h g ',g(z),f(z)) = 0. We also 
have A(hffi,h g ) = by Lemma [T3l 
Now 

^(ft/.s, ft s ; ii, u) - <f>(hf,o, h g ; u, v) 



= / (hffo)-hfUx))dx 



which, since s > is non-decreasing in v and independent of 
u. Hence 

< tf>{hf, a ,h g ; g(z), f(z)) - 0O/,o, h g ; g{z),f(z)) 
< <P(hf, 5 ,h g ; 1, 1) - 0(ft/,o, ft 9 ; 1, 1) 
= A(hf,„,hg) - A(h ffi ,hg) 

from which we obtain 

< <P(h f , s ,h g ; g(z)J(z)) < A{h f<s , h g ) 

■ 

Lemma 18: Let /, g G ^(-oo.+oo) with <? continuous. 
Assume that / = ft/ o 5 for ft,/ G ^[o,i]- Then 

/(*) ^h f (g{x)) ^g(x) e J hf 

and if / ^ ftj o j on a set of positive Lebesgue measure, 
then there exists 7 G Xr g i such that g(7) G iTfe, and such that 
f(x) 7^ hf(g(I)) on a subset of J of positive measure. 

Proof: By definition, / = htog means f(x) 4= hf(g(x)) 
for all x so we can have f(x) ^ hf(g(x)) only if g(x) G Jh f . 
It follows that 

{x : /(a) # ft/(<?(x))} C U ueJhf \g- 1 (u-),g- 1 (u+)] . 

Since ^{x : f(x) ^ hf(g(x))} > (where [i is 

Lebesgue measure) we have fi({x : f(x) ^ hf(g(x))} D 

[g- 1 (G-),g- 1 (G+)}) > for some G G J h} . Then I = 

\g-\G-),g-\G+)] 6% ■ 

Lemma 19: Let /. g G ^(-oo, +00) be interpolating. If 



ft/ and ft 



Is,/" 



ft ff then / = hf o g^^ and 



B. uj is positive on all R. 

C. w is regular, s = 0, and (hf,h g ) satisfies the strictly 
positive gap condition. 

D. to is regular, (ht,h g ) satisfies the strictly positive gap 
condition and J hf n J h -i = and J hg n = 0. 

Proof: If ft/ is continuous then = and, by Lemma 
fl~8l / = ft/ o then implies / = ft/ o g"' 5 Thus, case A is 
clear. 

If u(x) > for all x then g u (x) is increasing (strictly) on R 
and takes values in (0, 1). Hence (p*")" 1 ^-) = (.g")~ 1 (G+) 
for all G G (0, 1) and we see by Lemma 1 1 8 1 that / 4- ft/ o g M,s 
then implies / = ft/ o g"' 5 . This shows case B. 

Assume ui is regular and s = 0. If g%(x\) — then 
Lemma QT| yields T(ui, f,g;xi,Xi) = which implies 
<j)(hf,h g ;f(xi),g(xi)) = 0. By Lemma [3] this violates the 
strictly positive gap condition if g w (xi) G (0,1) so the 
condition implies that g u is strictly increasing on {x : < 
g u (x) < 1}. Since ft/ is continuous at and 1 by Lemma [7] 
part C now follows from Lemma [T8l 

To show part D assume ui is regular and that (hf,h g ) 
satisfies the strictly positive gap condition. Assume / ^ 
ft/ o g u ' s . We have / = ft/ o so we apply Lemma 
1X81 to obtain I — s G (so 7 G Ifg^]) such that 

G = g"' s {I-s) = ^(7) G J/^ and such that /(x) + ft/(G) 
on a set of positive measure in 7 — s. We claim that f u is not 
constant on (7)^ and hence we have G G J h -i- 

To prove the claim assume is a constant 7 1 on (7)^. 
Then f(x) = F on (7) 2V[/ which, since |s| < 2Wby Corollary 
|2] gives /(x) = F on (I—s) s for some <5 > 0. This, however, 
implies ft/(G) = F and G G" ,7^,, which is a contradiction. 

Hence / ft/ o g w ' s implies J,^. n J h -i ^ 0. Similarly, 
.g/ /i 9 of implies ^ nj^-i 7^ 0- ■ 

G. Inverse Formulation. 

It is instructive in to the analysis to view the system in 
terms of inverse functions. Let g(x) — h((f<S>u>)(x)) with / G 
^(-co.+oo)- Then, for almost all u G [0, 1] we have ft~ 1 (u) = 
Jp 1 — / _1 (u))dw . To show this we first integrate by 

parts to write (f®uj)(x) = Sl(x—y)df(y) and then make 
the substitutions v = f(y) and u = g(x). It follows that, up 
to equivalence, the recursion <[3j may also be expressed as 



h-\u)= 1 n(( 9 T>) - (/T>))d«, 



hf(v) 



1 (12) 

n((/ t+1 )" 1 (i;)-(9 t )- 1 M)dn. 



g = h g o f u in any of the following scenarios. 
A. hf and h g are continuous. 



Since to is even we have f2(x) = 1 — f2(— x), so we imme- 
diately observe that if (/, g) G +00 j is an interpolating 
fixed point of the above system then 

1 = J h- 1 (u)du + ft,- f 1 (u)dv 

= / h g (u)du+ / hf(v)dv . 
Jo Jo 

This puts a very strong requirement on (ft/, ft g ) to admit an 
interpolating spatial fixed point. 
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Assume that / and g, both in ^(-oo.+oo)! form an inter- 
polating spatial fixed point. Consider perturbing the inverse 
functions by <5/ _1 and Sg" 1 respectively. We could then 
perturb hj 1 and h~ 1 , by ShJ 1 and Sh^ 1 respectively so that 
the perturbed system would remain a fixed point. To first order 
we will have from ( TOI l. 

5h-\u) = f u{g-\u) - r\v)){Sg-\u) - Sf-\v))dv, 
Jo 

6k J liv) = J "(r\v) - g-^u^Sf-'iv) - Sg-^u^du. 

This formulation is at the heart of the analysis in the 
following section. 

H. The Piecewise Constant Case 

In this section we focus on the case where hf and h g are 
piecewise constant. In this case the spatially coupled system 
finite dimensional. We further assume that uj is strictly positive 
on R. This ensures that no degeneracy occurs when determin- 
ing EXIT functions from spatial functions since j^g^ix) > 
for any non-constant g G ^(-oo.+oo)- 

We will write piecewise constant functions hf,h g S ^[0,1] 

as 



h f (u) 



E 



5? H(t 



where H is the unit step (Heaviside) function and where we 
assume Sf,8f > 0, and Ylf=\ = 1 and Eti = 1- 
Generally we will have < u{ < u| < • • ■ < vrL/ < 1 and 
< uf < uf < • ■ • < u B Kg < 1 but note that the ordering 
is not critical to the definition. We generally view the vectors 
8* and 5 9 as fixed and to indicate the dependence on u* = 
(u{, . . . , uLf ) and u 9 we will write hf(u; n?) and h g (u; u 9 ). 

Piecewise constant h / and h g also have piecewise constant 
inverses. Given hf as above we have 



h-\v) 



Kf 

=Etf 

0. 



ii)H(« 



E# 

k=l 



where we set u w 

If g 6 ^(-00, +00) is continuous and interpolating and hf is 
as above then / 6 ^(-00, +00) defined by f(x) = hf(g(x)) is 
also piecewise constant and can be written as 

K* 

/(z) = ^/H(z- Z f) 

i=l 

with —00 < z{ < < • • • < % K f < 00 where u{ = g(z{) 
(for some version of hf.) As before, we have 

/■ 1 («)=E^-ii) H ("-E f i)- 

i=i fc=i 



The purpose of this section is to prove a special case of 
Theorem [T] under piecewise constant assumptions on EXIT 
functions and regularity conditions on oj. For convenience we 
state the main result here. 

Theorem 10: Assume w is a strictly positive and C 1 av- 
eraging kernel. Let (hf,h g ) be a pair of piecewise constant 
functions in ^jo.i] satisfying the strictly positive gap condition. 
Then there exists unique (up to translations) interpolating 
functions J-,Q<E ^(-00, +00) an d s £ R satisfying sgn(s) = 
sgn(A(/i/, h g )), such that setting f*(x) — F{x — st) and 
g t {%) — Q{x — st) solves (0. Further, if we initialize (fJJ 
with any f e * ( _oo,+oo), then - -> 

J r_1 (w) — Q~ l {u) for almost all u,v and J r_1 (u) — C? _1 (it) 
depends continuously on the vectors if , u 9 . 

The remainder of this section is dedicated to the proof of 
this result. Our proof constructs the solutions T and Q by a 
method of continuation. In the case where h r and h g are unit 
step functions it is easy to find the solution: T and Q are also 
unit step functions. Starting from such a solution we deform 
it to arrive at a solution for a given hf and h g . We do this in 
two stages where in the first stage s = and in the second is 
s varied while h g is held fixed. The deformation is obtained 
as a solution to a differential equation. To set up the equation 
we require a detailed understanding of the dependence of u' 
and u 9 on z^,z 9 and s. 

Let us first consider the case s = 0. Thus, let f(x;z,f) and 
g(x;z 9 ) be a piecewise constant functions parameterized by 
their jump point locations tJ and z 9 as 

K 3 

ff (x;z«) = ^^H(x-zf) 
i=l 
Kf 

f(x;zf)=J2* f j K(x-z f j) 
3=1 

Then, from (13[ we have 

Kf 

u? = r( Z ?) = ^5/Q( Z ?- z j) 

i=i 

K 9 

<=^)=EWr z . 9 ) 



(13) 



(14) 



Now, suppose we introduce smooth dependence on a param- 
eter t, i.e., we are given smooth functions z* (t) and z 9 (t) 
and then determine vJ {t) and u 9 (t) from the above. By 
differentiating we obtain 



d_ 

dt 



u 9 (t) 
uf(t) 



H(zf(t),z 9 {t)) 



dt 



z 9 {t) 
zf(t) 



(15) 



where H \if (t) , 7? (t)) is a {K 9 + K*) x (K 9 + K f ) matrix 

jjf _tv/" 



H(zf,z 9 ) = 



-N 9 D 9 



(16) 



which we rewrite as H = D(I — M), and where 



where we set z 







D 

and where 



D* 
D 9 



and M 



{D f )- 1 N f 
(D 9 )- 1 ^ 
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D 9 is the K f x diagonal matrix with 



D 9 

%.% 



9 X \ 



K.0 



13^ is the K 9 x X 9 diagonal matrix with 



K 1 

E< 



iV 9 - 5 is the x X 9 matrix with 



TV 9 - 



dff"(zf;z 9 ) 
9zf 



w(zf 



TV^ is the if 9 x K f matrix with 

ar( z f ;z /) 



9z| 



Since 13 



5 _ 



E 



K" 



, V;" y and D(. 



w(z{ -zf)<5f. 



iV/ ■ we observe 



Mi j = 1. 



that M is a stochastic matrix: Ej=i +X 

Our strategy for constructing fixed points for a given hf,h g 
involves solving (15[ for z 9 (t), z-^(t) given u^(i),u 9 (i). The 
main difficulty surrounding this is that H(z^,z 9 ) is not in- 
vertible. In particular, (7 — M)l = 0. This is a consequence 
of the fact that translating z^ and z 9 together does not 
alter u 9 and u/ as defined in (TT~4-b . The corresponding left 
eigenvector of ff(z* , z 9 ) arises from the fixed point condition 
Jo h g (x)dx + J hf(x)dx = 1 which here reduces to 



Ki 

E 



(i 



E 

i=l 



(l-uf)5f, 



hence 



^ J eft 



A» 



E^ 9 



as can be verified directly. 
Let us consider the matrix 



dt 



9 ) + 1^ 



where 1 is the column vector of all Is and 5 is the col- 
umn vector obtained by stacking S 9 on 8* . This matrix is 
invertible, i.e., its determinant is non-zero. To see this note 
that M is a positive stochastic matrix Ml = 1 and by 
the Perron-Frobenious theorem all other eigenvalues of M 
have magnitude strictly less than 1. It follows that 1 is the 
unique right null vector of H(z^,z 9 ) (up to scaling) and 
that 8 is the corresponding left null vector. The left subspace 
orthogonal to 1 is invariant under H(z',z 9 ). It now follows 
that H(zf,z 9 ) + IS? has no left null vector and is therefore 
invertible. 

Now, consider the differential equation 



d_ 

dt 



z 9 (t) 
zf(t) 



= (H(zl(t),z 9 (t)) 



' dt 



u 9 (i) 
uf(t) 



(17) 



dt" 



If 

satisfied. 



u 9 (t) 



then 



dt" 



'(*)' 
f (*). 



and |Q3) is 



Lemma 20: Let to be a strictly positive smoothing kernel. 
Let u* (t) and u 9 (i) be C 2 ordered vector valued functions 
on [0,1] such that (hf(;\i^(t)),h g (;u 9 (t)) are satisfy the 
strictly positive gap condition uniformly in the sense that 
min te[o,i] <f>(hf(;u f {t)),h g (;u 9 (t);u,v) > for all (u,v) £ 
[0, 1] 2 \{(0, 0), (1, 1)} and A(h f (; U /(i)), h g {- u 9 (t)) = for 
all t £ [0, 1]. Assume further that z-^(O) and z 9 (0) are given 
so that /(; z-^(O)) and g(;z 9 (0)) as defined by (fl~3T > satisfies 
g(x;z«(0)) = h g (r(x;zf(0));u 9 (0)) and /(z;z 9 (0)) = 
h f (g" (x;z g (0));u f (0)) for all x £ R, i.e., the determined 
functions form an interpolating spatial fixed point for the t = 
system. Then there exist bounded C 1 ordered vector valued 
functions z f (t) and z 9 (<) on [0,1], with z f (0) and z 9 (0) 
as specified, such that g(x;z 9 (t)) = h g (f u (x; z f (t)); u 9 (i)) 
and f{x;z 9 {t)) = h f (g u (x;z 9 (t));u f (t)) for all x £ K and 
t£[Q,l}. 

Proof: Consider the differential equation (ill with ini- 
tial condition given by z 9 (0) and z-*(0). By translating 
(adding a constant to both) we can assume Et=i ^i z i (0) + 
E^Li ^/ Z J(0) — 0- By standard results on differ- 
ential equations, the equation has a unique C 1 solu- 
tion (z 9 (t),zf(t)) on [0,T) for some maximal T > 
0. Since !(£S<5X(i) + EjL'i *N(t)) = we 
have £(E£i + Ejl'i = and hence 

E£l^ zS (*) + EjLi 5 / z iW = °- Further, the solution 
satisfies ( fT51 ) and it follows that the determined functions 
/(; %' (t)) and g(; z 9 (i)) are corresponding interpolating spatial 
fixed points for vj (t)), h g (; u 9 (t)). Lemma [TT1 implies 
that z* (t) and z 9 (t) are bounded and we can conclude that 
the solution exists for all t £ [0, 1]. ■ 
Now we consider adding a shift to the model. We generalize 
(fl4] i as follows 



(18) 



Kt 

A^ 

= gr(zt + s) = E ^/ fi ( z i + s - z f ) 

Now, let z 9 (t), z' (t),s(t) be smooth functions of time, then 



d_ 

dt 



u 9 (t) 
uf(t) 



d 


-z 9 (ty 







di 


zf(t)_ 


+ 





d , s 
dt 5 ^ 
(19) 



where H(zf(t), z 9 (t)) is a (K 9 + K?) x (K 9 + K f ) matrix 
H{z f ,z 9 ) = 



N 9 > s D 9 '* 
D[I - M] 



(20) 
(21) 



where 

D = 



Di 
£> 9 < 5 



and M 

where D> and JV* are as before and 



{D f )- x N f ' 

( D g,syl N g,s o 
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D 9 ' s is the K$ x diagonal matrix with 



K 9 



• N 9 ' 5 is the K f x K 9 matrix with 

:u;( Z ?-( Z f 



N?' s - 

i,3 



Since Dff 



E 



AT?'* 



and D 



= E 



M, 



1. 



observe that M is a stochastic matrix: 

Let P be the projection matrix which is the [K* + K 9 ) x 
(K* + K 9 ) identity matrix except that Pk/+ks Kf+Ks = 0. 
It follows that / — PMP is invertible and PMP has spectral 
radius less than one. Indeed, let B\ denote the matrix obtained 
from (Dt )~ 1 Nf be removing the rightmost column and let B2 
denote the matrix obtained from ( K D 9 ' 5 )~ 1 N 9 ' 5 be removing 
the bottom row. Then 



M 2 = 



(BiB 2 f k 






(Mi) 2 



Let r' > be such that n^ Kf (r') < 1 and assume that 
(hf(;r'),h g ) satisfies the strictly positive gap condition with 
A(h f (; r'),h g ) > 0. Define s(t) = s(0) + t. 

Then there exists C 1 functions z f (t) and z 9 (t) for t G [0, T], 
where T < 00, with z^(0) and z 9 (0) as given, such that 
/(;z^(t)),g(;z 9 (t)) G *(-oo,+oo), form a spatial wave so- 
lution with shift s(t) for (hf(; r(t)), h g ) and where r(t) is an 
increasing C 1 function with r(0) = 0, and r{T) = r' . 

Proof: Consider the differential equation (l22l i. By stan- 
dard results on differential equations a unique solution exists 
on [0, T') for some maximal T > 0. Note that z f (t) and z 9 {t) 
are component-wise decreasing in t, except for z„ s (t) which 
is constant. 

It follows that 



-g^ z f Kf+S (t);z 9 (t)) 



3=1 



dt 



Let £ < 1 denote the maximum row sum from B\. By 
the Perron-Frobenious theorem B2B1 has a maximal pos- 
itive eigenvalue A with positive left eigenvector x. Then 
x T B2B1I = Xx T l, but B2B1I < £1 (component-wise) 
so A < £. We easily conclude that ||M 2 ||2 < £• Hence 
(I — PMP)^ 1 exists and is strictly positive. 
Given z^(0),z 9 (0) we define z 9 (t),z^(t) as the solution to 



di 



z 9 (t) 
zf(t) 



= -(I - PM(z f (t), z 9 ^))?)- 1 P 



(22) 



Note that 



dt 



V(t)" 


d 


-z 9 (t) 


zf(t)_ 


~ dt 


zf(t)_ 



Now we substitute the solution into ( fT9l ) and we obtain 



4 

dt 



uf(t) 



= D 

= D 
= 0. 



P V- M ^dt 



P(I- PMP) 



z 9 (t) 
zf(t) 



P 



dt 



z 9 (t) 
zf(t\ 




1 

P 



Lemma 21: Let z-*(0),z 9 (0) be given, thereby defining 

/(;z^(0)) and <?(;z 9 (0)) in <&(_oo, + oc) and set 



which is strictly positive for all t € [0, T') since ^z|(t) < 0. 
It follows that /(; z-* (t)), <?(; z 9 (t)) form a spatial wave solu- 
tion with shift s(t) for (h f (;r(t)),h g ) for all t G [0,T') and 
that r(t) - ^(z^ + s(i); z 9 (t)) - ff "(z^ + a(0); z 9 (0)) is 
monotonically increasing on [0, T"). 

We now show that r(t) < r' implies that Z(t) is bounded. 
As a first step we show that s(i) is bounded. If r < r' then 
there exists (u,v) with v < hf(u—) and w < h g (v—). In 
particular if we take u > r' and v > / w (z| a (0); %f (0)) = 
f u {z 9 Zg (t); z'(t)) then we obtain a finite upper bound on s(i) 
from Lemma [15] 

Assume there exists ti — > T" < T' from below such 
that f(;U) -> /, -> 9 and ->■ r < r '- Fr ° m 

Theorem [Tn it follows that (/(— 00), <?(— 00)) G x(hf(',r),h g ) 
and $>(hf(;r),h g ;f(—oo),g(—oo)) = 0. By the assumptions 
on /i g we see that the crossing point cannot be interior. Thus, 
(/(— 00), g(— 00)) = (0,0) and we conclude that z 9 (t) and 
zf(t) are bounded. Hence T" < T' . 

Finally, an upper bound on ||z 9 (i)|| yields a positive lower 
bound on 4+T(t) so we conclude that there exists T <T' such 
that r{T)=r'. ■ 
Proof of Theorem [TOr Let us first consider the case 
A(hf,h g ) = 0. Let the target EXIT functions be hf = 
hf(;uf) and h g = h g (;u 9 ). Let By Lj = J Q hj 1 (x)dx = 

Ej SH> and B hg = ft h g \x)dx = E^fuf = 1 - B hf . 
For t G [0, 1] define the vector valued functions 



Let s(0) > also be given and let h/(;r) be parametrized 
piecewise constant functions defined by hf(x;r) = 
h f (x; n f (r)) = Ei=i H H(a; — uf(r)) where 



Z^ 1 ! — 



V(z{(o)+s(o);z 9 (o)) 

o-(z^(0)+s(0);z 9 (0)) + r i = X^ 



Note that /(jz-'(O)) and 5(;z 9 (0)) form a traveling wave 
solution for hf(; 0), h g with shift s(0). 



u»(t) 



t)B h/ l 



(1 



tu J 
tu 9 . 



(23) 



where 1 denotes a vector of all Is (of appropriate length). 
Note that we have u-^(l) = and u 9 (l) = u 9 . Note that 
hf(\\J(t)) and h g (;u 9 (t)) are in *[ 0)1 j for all t. Note that 

Jo hf(v; uf{t))dv = B hf and ft" 1 '^; u 9 (i))dw = B,, 
A(ft/(;u'(*)),fc ff (;u*(i))) = for all t G [0,1]. 



so 
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Let h G ^[0,1] and let (u, v) be in the graph of h. Then 

c/>{h, h g (; u 9 (t)); u, v) - c/>{h, h g (; u 9 (l));u, v) 



(l-t)(uB hg - / /i- 1 (z;u»(l)))dz 



>0 



where the last inequality holds since we have equality at 
u = and u = 1 and (uBh g — L hj 1 (z; u 9 (l)))dz is 
concave. This implies that if (h, h g {; u s (l))) satisfies the 
strictly positive gap condition with A(h, h g (; u 9 (l))) = then 
(h, h g (; u 9 (t))) also satisfies the strictly positive gap condition 
with A(h,h g (\\x 9 {t))) = for all t G [0,1]. 

The above argument shows that (hf(; u^(l)), h g (; u 9 (t))) 
satisfies the strictly positive gap condition for all t G 
[0,1]. Applying the argument analogously to hf we see 
that (hf(; u*(s)), h g (; u 9 (t))) satisfies the strictly positive 
gap condition for all s,t G [0,1], and, in particular, 
(hf(; uf(t)), h g (; u 9 (t))) satisfies the strictly positive gap con- 
dition for all t G [0, 1]. 

All that remains to apply Lemma [20] over t G [0, 1] and 
conclude the proof for the case A(h f ,h g ) = 0isto find z-^(O) 
and z»(0). Set z'(0) = so that f(x;zf(0)) = H(x). Let 
y be the unique point such that /"(y;z^(0)) = Bh and set 
each component of z 9 (0) to y so that g(x\ z 9 (0)) = H(x — y). 
It follows that g(x; z s (0)) = h g {f u: (x] z^(0)); u 9 (0)) and that 
f(x;zf(0)) = h f (g"(x;z 9 (0));uf(0)). 

Applying Lemma l20l for t G [0, 1] we obtain /(; z-^(t)) and 
g(;z 9 (t)) such that g(x;z 9 (t)) = hg(f u (x; z* (t)); u 9 (t)) and 
f(x;zf(t)) = hf(g u (x;z 3 (t));uf(t)) completing the proof 
when A(hf,h g ) — 0. 

We now consider the case A(hf,h g ) ^ 0. Without loss of 
generality we assume A(ht, h g ) > 0. The case A(hf, h g ) < 
is equivalent to the case A{hf, h g ) > under symmetry. 

Let us introduce a modification of hf(;\x^(t)) as follows. 
For r G (0,1) define n^(t;r) by u{(t;r) = mm{u{ (t), r}. 
Then J™ hi (x;\J (t;r))dx is non-decreasing in r for all 

u G [0)1] < Since hj 1 (x)dx > 1 — f Q h~ g 1 (x)dx and 
Jo ^/ u ^(^i 0))dx — there exists a unique positive r < 
xJ Kf such that f Q h~ 1 (x; u.f (t; r ))dx = 1 — f Q h~ 1 (x)dx. 

We claim that for all r G [ro,n^ Kf ] the pair (hf(;r),h g ) 
satisfies the strictly positive gap condition. To establish the 
claim we need to show that <P(hf(;r),h g ) > A(hf(;r),h g ) 



on x°(hf(;r), h g ). Let (u,v) G x°(hf(;r),h g ). Note that this 
implies u < r since h g is continuous at 1 by Lemma Q If u < 
r then (u, v) G x°(hf, h g ) and we have <f>(hf{; r),h g ; u, v) = 
(f)(hf,h g ;u,v) > A(hf,h g ) > A(hf(;r),h g ). If u = r 
then we have v > hf(u—;r) and hj (v';r) = v for all 
v' G («, 1]. Applying © we have (f)(hf(;r),h g ;u,v) = 
<fi(hf(; r), h g ; u, 1) and applying (0 and using continuity of 
/i g at 1, we have (f)(hf(;r),h g ;u,l) > <p(hf(;r),h g ;l,l). 
Hence (f>(hf(;r), h g ;u,v) > A(hf(;r),h g ) and the claim is 
established. 

Applying our result for the s = case we can find /, g G 
^(-oo.+oo) that form an interpolating spatial fixed point pair 



for (hf,h g (x;ro)). We now apply Lemma |2T1 in a series of 
stages increasing s (linearly s = t) and adjusting and z 9 so 
that h* ' 9 is held fixed while h 9 '* tracks h g (x;r(t)). The 
process can be decomposed into stages where in each stage 
U2,i-i < r(t) < U2 } i for some i, and where in the final stage 
i = K* . In each stage s(t) and r(t) is increasing until, at 
the end of the stage, r(t) = v,2,i- During the stage where r(t) 
increases to U2,i we have U2,j(t) = r(t) for all j > i. We can, 
in principle, simplify the notation by collapsing these indices 
to a single value, i.e., to assume that i = K* . In this way 
we reduce each stage to the case i = K* (while admitting an 
initial condition So > 0). Lemma |2TI therefore completes the 
proof. ■ 

/. Limit Theorems 

Let us introduce the notation g u >*(x) = g u (x + s). Then, 
we have the bound 

g"<*(x)-g"'>*'(x) = 

(g(x — s) — g{x — s'))uj(y — x) dx 



+ g{x - s'){w{y - x) - u' {y - x)) dx 



\g u >*(x)-g u '>*'(x)\ < |s-b / ||H| 00 + ||w / -« / ||i (24) 

Theorem 11: Let /j, gi,Si,u>i, i = 1,2,3,... be sequences 
where (ft,g t ) G ^jL^+oo) are interpolating, G K, and lo 1 
are averaging kernels. Assume 

fi -> f, 9i -> 9, St ->■ s, and uj { -> u (in L x ) , 

where |s| < cxo. (Note that we do not assume / and g are 
interpolating.) Further assume 

h ih,9t^\ -> h f> hauf:*] ~> 119 

for some hf,h g G ^[0,1] respectively. Then we have the 
following 
A. 



/ = h f o g u and g = h g o f u 



B. 



if (-00), ff(-°°))) (/(+°°)) e xihf, h g ) 

C. If s = then 

=$(&/, h g ;fi-oo),g(-oo)) 
=$(hf,h g ;fi+oo),g{+oo)). 

and, for all xi , X2 

$(/!/, . 9 "(a; 2 )) = f (w; /, g; x u x 2 ). 

D. For («,«) G {(/(-oo) >fi f(-oo)),(/(+oo),5f(+oo))} 

min{0, A(hf, h g )} < $>(hf 7 h g ;u, v) < max{0, A(hf, h g )}. 

Proof: Since gi — > g, uji —> w and Sj — > s we have from 
(l24l i that g" i,5i -> point-wise. 

If x is a point of continuity of / then fi(x) — > /(x) and we 
have (g Wi ix +Sj),/j(a;)) — ^ (.g w (x +s), /(a;)) which implies 
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f(x) = hf(g u ' ,s (x)). Since g u is continuous we can extend 
this to all x by taking limits. This shows the first part of A, 
the second part is similar. 

It is clear that f u (-oo) = /(-oo) and g u (-oo) = 
<?(— oo). It now follows from part A that (/(— oo), g{— oo)) 
and (/(+oo), g(+oo)) are both crossing points of (hf,h g ), 
giving part B. 

Now we consider part C where we assume s = 0. It follows 
from d24l > that g"* — > g u point-wise and that h,j>. (/ ^»- — > hf. 
It is quite easy to see that 

$(h},hl;f^( Xl ),g^(x 2 )) 
^$(h f ,h g ;r( Xl ),g"(x 2 )). 

since f"* — > f u and g?' —> g u uniformly. By Lemma [10] we 
have 

^(h t f,h t g ;f" i (xi),gi i (x 2 )) = fi, K m, x 2 ) 

and since fi — > /, gi — s> g and Wj —> u) we easily obtain from 
Lemma QT] that 

$(ft/,^;r(-oo) )ff "(-oo)) = 

and 

$(/i / ,/i ff ;r(+oo),^(+oo)) = 0. 
It now follows from Lemma [10] and part A that 

®( h f> h g 'i rixi)^"^)) = /: 91 Xl,X 2 ) 

for all x\, x 2 . 

Finally, we show part D. If s = then part C gives part D. 
By choosing a subsequence if necessary, we can assume that 
hif. g "i-i converges to some hf G Vf^o.i]- 

We assume s > 0, the case s < is anal- 
ogous. Then hf > hf we have $>(hf,h g ;u,v) — 
<&(hf,h g ;u,v) = J Q (hf(x) — hf(x))dx < 0. For 
(u,v) G {(/(-oo),#(-oo)),(/(+oo),#(+oo))} we have 
<&(hj-,h g ; u, v) = by part C, and therefore h g ; u, v) — 

fi{hf{x)-h f {x))dx>Q. 

Now A(hf,h g ) - A(hf,h g ) = f£(hf(x) - h f (x))dx > 
^{hf{x) — hf{x))dx and since A(hf,h g ) = 0, 
we have $(hf,h g ;u,v) < A(hf 7 h g ) for (u,v) G 
{(/(— 00), g(— 00)), (/(+00), g(+oo))}. This completes the 
proof. ■ 

The following result is largely a corollary of the above but 
it is more convenient in application. 

Lemma 22: Let (hf,h g ) G ^ satisfy the strictly posi- 
tive gap condition. If there exists a sequence of interpolating 
fi, gi G *(_oo,+oo) and finite Si such that (h f ,h g ) -> (hf,h g ) 
and LUi — >• in Li, where ft,^ = /ir^ ^••ii and /i* = 
h, g y,»>i,»i-|, then there exists interpolating f,g & ^(-00, +00) 
and finite s, all limits of some translated subsequence, such 
that h f = h { f^, t] and h g = h [g j»y 

Proof: Since u)i — > w in ii and (W, /i* ) — > (hf, h g ) we 
conclude from Lemma [T6l and Lemma [T5l that |s, | is bounded. 

By translating / and g as necessary, we can assume that 
/ Wi (0) = 1/2 for each i. Taking subsequences as necessary, 



2 — y OO 1 ■ — ^ OO '2. ^ OO 

we can now assume that fi > f, gi > g, and Sj > 

s, for some finite s. 

We claim that / and g are interpolating. For all (u, v) G 
X°(hf,h g ) we have $(hf,h g ;u 7 v)$(hf,h g ;u,v) > 
by assumption. By Theorem [TT] part D we now have 
(/(-oo), ff (-oo)) G X (hf,h g )\x°(hf,h g ) = {(0,0), (1,1)}. 
Since f u (0) = \ we must have (/(-oo), ff(-oo)) = (0,0) 
and (/(+00), <7(+oo)) = (1, 1), proving the claim. ■ 

7. Existence of Spatial waves: general case 

In Section IV-HI we proved Theorem QJJ a special case 
of Theorem [JJ in which h 9 and /i / are piecewise constant 
functions and ui is C\ and strictly positive. In this section we 
show how to remove the special conditions to arrive at the 
general results. We make repeated use of the limit theorems 
of Section [V-fl and develop some approximations for functions 
in ^[0,11- It is quite simple to approximate h G ^[0,1] using 
piecewise constant functions. The challenge is to approximate 
a pair (h g ,hf) so that the strictly positive gap condition is 
preserved. 

1 ) Approximation by Tilting: In a manner analogous to (l23l l 
we define a perturbation of hf,h g as hf(;i),h g (;t) for t G 
[0,1] by 

h- f \v;t) = {l-t)B hf +th-f\v) 
h-\u;t) = {l-t)B hg +th-\u), 
This can also be expressed as 

hf(u;t) = hf( -HL+B hf ) 

V d (26) 
h g (v,t)=h g [ -^ + B hg ), 

with appropriate extension of hf and h g outside of [0,1], 
hf(x) = h g (x) — for x < and hf(x) — h g (x) = 1 
for x > 1. 

Letting /i denote either hf or we clearly have 

/ h- 1 (x;t)dx = B h (27) 
Jo 

for all t. Note also that /i _1 (w;i) - h^ 1 ^) = (1 - 
t)(Bh — /i _1 (w)) is non-increasing in w. It follows that 
J h~ 1 (x; t)dx > L h~ x (x)dx for all w G [0,1] and we 
obtain 

<(>(hf(;t),h g (;t);)>cl>{hf,h g ;) (28) 

for all t G [0, 1]. 

Lemma 23: Let (h g ,hf) G $Lj satisfy the strictly pos- 
itive gap condition. Then, there exists e > such that 
(h g (; t),hf(; t)) satisfies the strictly positive gap condition for 
any t G (1 - e, 1]. 

Proof of Lemma 123} For the case A(hf,h g ) = 
equation d27l ), inequality d28| i and Lemma [3] gives the result 
immediately. By symmetry we now need only consider the 
case A(hf, h g ) > 0. 

By Lemma [9] and d28| i it is sufficient to show that 
X°(hf(;t),h g (;t))nS(hf,h g ) = for t G [1 - e, 1]. 
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In addition there exists a minimal and positive element 
(u*,v*) £ x°(hf,h g ). There exists a neighborhood TV of 
(0,0), which we take to be a subset of C [0,u*) x [0,v*), 
in which h~ l (u;t) > hg 1 ^) and hl x (v;t) > hj 1 ^). It 
follows that X °(hf(;t),h g (;t)) DAf = for all t. 

Let S > be small enough so that ((0,0)) 5 C TV and 
((x*,y*)) s n S(hf,h g ) = 0. For e small enough and t £ 
[1 - we have x{hf(;t),h g (;t)) C (x(hf, h g )) s and it 
now follows that x°(hf(;t),h g (;t)) nS(h f ,h g ) = 0. ■ 

2) Piecewise Constant Approximation: Given h £ ^[o,i] 
let us define a sequence of piecewise constant approximations 
Q n (h), n = 1,2,... by 



Qn(h)(x) 



1 

} — H(x — u r , 
^— ' n 



where we set 



and we have 



rT/ ra 

/l / h~ 1 (v)dv 



1 — 

)„(^)(*KT = ]r^-^ 

= / (1 - h-^(x)dx 
Jo 
»i 

h(x)dx. 

io 

In general, it holds that J Q Q n {h){x)dx = h(x)dx. It also 
follows that J Q Q n (h)(x)dx < h{x)dx for all z € [0, 1]. 

Lemma 24: Let (h g ,hf) be pair of functions in $mi] 
satisfying the strictly positive gap condition such that for 
some r) > we have ft 9 (x) = hf(x) = for x G [0, 77) 
and h g (x) = hf(x) — 1 for x £ (1 — 77, 1]. Then, for 
all n sufficiently large (Q n (h g )iQn{hf)) satisfies the strictly 
positive gap condition. 

Proof: We have A(Q n (h f ),Q n (h g )) = A(h f ,h g ) and 
< fi(Qn(hf),Qn(h>g)) > <j)(hf,h g ) so it suffices to show that 

r{Qn(hf),Qn(h g ))nS(h f ,h g ) = fb. 

Since ft s and ft/ are on [0, rf) and 1 on (1 — 77, 1] it follows 
that x°{hf,h g ) C [rj, 1 — t?] 2 and X°[hf,h g ) is closed. Thus, 
for <5 sufficiently small we have (x°(hf, h g )) s C\ S(hf, h g ) = 
0. 

By Lemma [2] we now have x°(Qn(hf),Q n (h g )) fl 
S(hf, h g ) = 0. for all n sufficiently large. ■ 

3) Proof of Main Results: We are now ready to prove our 
main results. 

Lemma 25: Let (hf,h g ) satisfy the strictly positive gap 
condition. Then there exists interpolating (/, g) £ , 3 / (_ 00 +ca \ 
and 5 such that hf = hif^u,,^ and h g = hr g juy 

Proof: The simplest case is already established in The- 
orem [TO] and we first generalize to arbitrary uj. Assume that 
(h g ,hf) are both piecewise constant. Define lu^ = to <g) Gk 
where Gj(x) = -^=e~( kxS> I" 1 . It follows that u> k — > w in Li 
and HwfeHoo < || cj || oo . For each ojk we apply Theorem [TOl to 
obtain piecewise constant fk,gk € ^(-oo.+oo) (with corre- 



1 — ht. We can now apply Lemma [22] to 

conclude that the theorem holds for piecewise constant hf,h g 
and general w. 

Let now assume first that for some 77 > we have h t (x) = 
h g (x) — for x £ [0,77) and hf(x) = h g (x) — for x £ 
(1 — 77, 1] . Consider Q n {hf) an d Qn(h g ). We apply Lemma 
[24] and the preceding case already established to conclude that 
for all n sufficiently large there exists (piecewise constant) 
interpolating f n) g n £ ^(-00, +00) an d finite constants S n such 
that h[g nJ u,} = Q n (h g ) and fy/ fc , s w *> s »] = Qn(hf). Since 
Qn{h g ) and Q n (hf) converge to h g and hf respectively, we 
can apply Lemma [22] to conclude that the theorem holds for 
this case. 

For arbitrary (h g ,hf) we consider (h g (;t),hf(;t)). 

By Lemma [23] we can find a sequence ij — > 1 such 
(h g (;ti),hf(;ti)) satisfies the strictly positive gap condition 
for each i. By the preceding case, there exists ftuQu e 
^(-00, +00) ar, d finite constants Si such that ft[ gt .,/"] = 
h g {;U) and h^ ^.n^ = hf(;U). By taking a subse- 
quence if necessary we can assume that Si — > s. Since 
(hf(;ti),h g ;(ti)) — > (hf,h g ) we can apply Lemma [22] to 



obtain (f,g) £ *^ 00>+co) 



h = h 



such that hf = hu tt 



and 



Note that this Lemma implies that / = hf o g u > s and that 
g = h g o but not necessarily / = hfog^- 5 and g = h g of w . 
Theorem [JJ requires us to prove this stronger condition. 

Proof of Theorem Q} Since we assume that u is regular 
Lemma [19] shows that Lemma [25] implies Theorem [JJ except 
in the case J hf n J h -i ^ or J hg n J" h -i ^ 0. It turns 
out that this case can be handled by constructing (hf, h g ) — > 
(hf, h g ) with certain properties. The argument is lengthy and 
is relegated to appendix [C] ■ 



Appendix A 

Proof of Lemma \10\ 

We assume that the smoothing kernel uj has finite total 
variation hence ||w||oo < 00. For any / £ ^(-00, +00) a simple 
calculation shows that f u (x) — f u (y) < \\lo\\oo\x — y\. This 
implies that and f u is Lipschitz continuous with Lipschitz 
constant ||w||oo- 

Thus, g% and f£, the derivatives of g^ and f u , exist for 
almost all x and g u and j u are absolutely continuous. If lo(x — 
y) and g(y) do not have in common any points of discontinuity 
in y, then g%(x) = j_ u>(x — y) dg(y) where the right hand 
side is a Riemann-Stieltjes integral. The right-hand side can 
more generally be defined as a Lebesgue-Stieltjes integral for 
all x, but the equality may fail on a set of measure 0. We now 
have 



a»(-oo) 

X2 



h[f ig »](u)dv, 



sponding z ik , z 9k ) and constants s k such that h. 



[9kJ k k ] 



— 00 

X2 



f(x)g%(x)dx 

f(x)U uj(x~y)dg(y)^dx. 
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Since, J 2 f(x)u)(x — y)dx < f u {y) we see that the Fubini Finally, by combining the two forms and integrating from 
theorem can be applied and we obtain 



to oo we obtain 



OO PX2 



h [g jm]{u)du- 



g"(-oo) 



— oo «/ — OO 

OO rX2—y 



f(x)u(x - y) dx jdg(y) 
f(x + y)u(x)dx)dg(y) 



/-(-oo) 

= ff (xi)r (ari) + f(x 2 )g u (x 2 ) - f(x 2 )g(x 1 ) - /(-oo)s(-oo) 



co «/ — CO 



;(*)( 



;(*)( 



f(y + x)dg{y) )dx 



(g{xi) -g(y-x))df(y) 

(x 2 ,x 1 +x] 

(f(x2) ~ f(y~ x))dg(y) ) dx , 



where the inner integral is defined for almost all x. Similarly, 



(11,12+1] 

which completes the proof. 
Proof of Lemma 
As a first bound use the evenness of lj to write 



/"(-oo) 



,(*)( 



f u (x) 



g(y + x)df{y) )dx 



u(y)f(x + y)dy 



We can now exploit the evenness of uj to replace x with ~x 
in the above and uj{— x) with u(x) to write 



—00 

L 



u(y)f(x + y)dy- 



u(y)f(x + y)dy 



/-(-oo) 



h^j^(u)du- 



s"(-°o) 



h [f,g"]( u ) du 



< (l-e L )f((x + L)-) + e L 

<f((x + L)-) + e L (l-f((x + L)-)) 

<(f(x)+A L f(x)) + e L (l-f(x)) 



-00 
00 



uj(x) 



f(y + x)dg{y) 



f(y ~ x)dg{y) + 



X\-\-X 



g(y - x)df(y))& 



-00 

X\—X 



and 

ix 



g(y + x)df{y) )dx 



r(x) 



Consider the second form, in which we have the expression 



> 



-L 



u(y)f(x + y)dy 

> 

u(y)f(x + y)dy 



X 2 +X 



f(y - x)dg(y) 



g(y + x)df(y) . 



With a slight abuse of notation, we may write J^ 1 x g(y + 
x)df(y) as J* 1 g(y)df{y — x) and we see that for almost all 
x we have 



> (1 - e L )f((x - L)+) 

> f(x) - A L f(x) - e L f(x) . 

To get a bound on T(u>; f, g; xi,xi) we proceed similarly 



X 2 +X 



uj(x) 



g{y + x)df(y) 



f(y - x)dg(y) 



g{xi)f{xi -x)- g(-oo)f(-oo) + 

'(11,12+1] 

g{x\)f{xi - x) + f(x 2 )(g(x 2 + x) - gtxx)) 



(g(xi) - g(y - x))df(y))dx 



(x\,x\+x\ 

^(x)(A L g(x 1 )\f{x 1 +x)- f{x x )\ )dx 



-L 



- /(-oo)flr(-oo) - 

Thus, we obtain 

rr(*i) 

h [g>f *](u)du • 



(11,12+1] 



f(y - x)dg{y) 
(f(x 2 ) - f(y - x))dg{y) . 



g"(x 2 ) 



g-(-oo) 



h[f, g ^](u)du 



< 

+ / uj(x)(f(x 1 + x) - f{xi - x))d:r 

(x)^A L g(x 1 )A L f{xi)jdx + , 
< A L g(xi)A L f{ Xl ) +e L 
Thus, we obtain the bounds 

cj>(f(x),g(x)) < A L f(x)A L g(x) + e L 



< 



/-(-oo) 

g(x 1 )f u (x 1 ) + f(x 2 )g u (x 2 ) - f(x 2 )g(xi) - /(-oo) 5 (-oo) ${g"(x), f{x)) < (A L f(x) + e L )(A L g(x) + e L ) 



, K J(x 



(f(x 2 ) - f(y- x))dg(y) )dx, 

'(11,12+1] 

The same analysis applied to the first form gives 



r(*i) 



/-(-oo) 



h[gj»](u)du ■ 



g"(x2) 



g-(-oo) 



h lf,g"]{v)du 



+ A L f{x)A L g{x) + e L 
= 2A L f(x)A L g(x) 

+ e L (l + A L f(x) + A L g(x) + e L ) 
< 2A L f(x)A L g(x)+4e L 



g(x 1 )f u (x 1 ) + f(x 2 )g u (x 2 ) - f(x 2 )g( Xl ) - /(-oo) 5 (-oo) 



and since, by (0, 



;(*)( 



(12,11+1] 



(g(xi) - g(y -x))df(y) )dx 



\$(g"(x), r(x)) - f(x))\ < \r(x) - f(x)\ 

<A L f(x)+e L 



and 



\c/ ) (g(x),r(x))~cj ) (g(x)J(x))\ < \r(x)-f(x)\ 

<A L f(x)+e L 

the other bounds follow easily. ■ 
Appendix B 

In this section we show how spatial integration can be done 
directly in the spatially discrete setting. First, an unusual point 
of notation. Let gi be defined for all integers i. We will 
occasionally write a sum as ^2n^ a -\9i ■ ^ n tne case wnere 
a < b this would equal Yli=a+l 9* m tne usua l notation, when 
a = b the sum is 0, and when a > b the sum is — Ylietb a] 9i = 

- £i=6+i 9* ■ Note that £ie(o,&] (9i -9i-i) = 9b - 9a for all 
choices of a and b. Further, we can write 

a b 

E 9i+ E f< 

i— — oo i— — oo 

a 

= E (9i + ft) + E fi 

i= — oo ie(a,b] 

regardless of a and b. 

The spatially smoothed g will be denoted g w and is defined 

by 

w 

97 = E w <- / - 

j=-W 

where we require Wj — w_j and Wj > and J2j w j = 1- 
First we note 

fe 

E + fi~l)(9i+j ~ Si+j-l) 

i— — oo 

fc 

+ E +9i+j-i)(fi - 

i— — oo 

k 

= E ^/ifli+j - 2fi-l9i+j-l ~~ fi9i+j-l 
i— — oo 

+ fi9i+j-l + fi-l9i+j ~ fi-l9i+j 
= 2(fk9h+j - /-oofl'-oo) 



and we obtain 



E (/* + fi-l)(9i+j - 9i+j-l) 



1 — — 00 

ii 



- E (9i+9i-i)(fi-j ~ fi-j-l) 

i— — oo 

2 (fii—j9ii ~~ f— 00.9— oo) 

- E + ^" 1 ) ~~ 1 ) 

ie(ii-j',i2] 



(29) 



We now can write 

E Ui+fi-i)(9i-9ti) 

i— — oo 
i— — oo 

E W J'( E (fi+ fi-l)(9i+3 ~9i+j-l) 
i——oo 

n 

E (9i + 9i-i)(fi+j - fi+j-i) 



j——W i——oo 
ix 



= E w A 2 (fh-j9ii ~ /-oofl'-oo) 



«e(ii-j,i2] 

2 (fh9ii - /-oofl'-oo) 



- E W J E (/i + Zi-OCffi+J -fli+J-0 
j=-W i£(ii-j,»2] 

= 2 (/ l \5 , ti - /-oofl'-oo) 

+2/i 2 (flX-fliJ 



Vi' 



- E W J E (fi + fi-1- 2 fi 2 )(9i+j ~9i+j- 

j=-w 

= 2 (/n3u + ff£/*2 - /feflii - /-oofl'-oo) 



+ E W J E (fi + fi-i- 2 fi 2 )(9i+i-9i+j- 

j=~W ie(ii-j,»2] 

And finally we have the result 

2(« - /-oofl-oo) 

-( E (/i + /i-i)(ff7-57-i) 



I— — oo 



+ E fe+^-i)(/r-/r-i) 

2 — — OO 

2(/£-/ i2 )(fl£-<fe) 



E w j E - /» - fi-i)(9i+j - fli+j 

j=-W i£(ii-i,i 2 ] 



Now, if in place of d29l we write, 

E Cf< + fi-l)(9i-j - ffi-j-l) 



2— — OO 



E ^ + 9i-i)(fi+ 3 - /i+j-i) 

i— — oo 

2 (9l2—jfi2 /— Oo9 — oo) 

E + 9i-i)(fi+j - fi+j-i) 

ie(j2-3,ii] 
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and subsequently proceed similarly, then we obtain 

2(fi 1 9i 2 ~ f— oo9— oo) 

-( E (fi + fi-iM-gT-i) 



and 



2 — — OO 

ii 



+ E (j9i + 9i-i)(fT-fT-i) 

i— — oo 

2(/?-/i 2 )«-ffH) 



+ E W J E ( 25i i - 9i - 9i-i)(fi+j ~ fi+j-i) 

j=-W ie(*a-j,ii] 

A. Discrete-Continuum Relation 

In this section we obtain tighter bounds on the dependence 
on A. 

Lemma 26: For a spatially discrete fixed point for the 
regular ensemble we have 

^(/oo^-ACf-^g-oo)! < iai^'iu+u^iuiMiLA 2 

Proof: As before, we associate to the discrete spatial 
index i the real valued point Xi = iA. We assume that uj is the 
piecewise constant extension of w. Thus, (UJ holds trivially. 

Assume a spatially discrete fixed point f,g. Let / and g 
be the piecewise extensions of / and g. We can now relate 
the discrete spatial EXIT sum to the corresponding continuum 
integral to arrive at approximate fixed point conditions for 
spatially discrete fixed points. 

The discrete sum 

\ E (fi + fi-x)(9T-9T-x) 
f(x)dr(x) 

o — OO 

and, similarly, 

\ E (9i+9i-i)(JT-JT-i) 
g(x)df»(x) 

h sM (r(x))dr( X ) 

We want to compare f^* ^ hy~^^(g UJ (x))dg UJ (x) to 



We have 



Xi-l 

1 



i [lIUI] (r(x))dr(x) 



(hf(97) + hf( 9 7-M97 - 97-i) 
(ah f (g7) + ahfbZ^da (g7 - gT-i) 



h f (r(x))dr(x) 



hfiagj + agj^daigj - gj_ x ) 



Let g(a) — ag™ + agf_i- Then, assuming hf is C 2 we 
have by a simple application of the remainder theorem 



\ah f (g7) + ah f (gU) - h f (agY + agf-i)! < yCfff " 97-xY 

where C,; is the maximum of h"f(u) for u in [g7-x->97\- 
We now have 



{h [7rg ^{x))-h } (s u {x)))dr{x) 



< yG/f -97-if- 
Since T.M ~ 97-i) < 1 and 



gY - 9 7- 1 < A\\c\ 



we obtain 



(h ir ~ u] (r(x))-h f (r(x)))dr(x) 

< f (IMU) 2 A 2 

A similar argument applies to h g and , and the 

Lemma follows. ■ 

Appendix C 

In this section we prove Theorem Q] in the case where Jh f fl 
J^-i ^ or n 7^ 0- Without loss of generality, we 
focus on the case s > 0. 

Given an interval / let x(I) denote its right end point and 
let x(I) denote its left end point. For two closed intervals 
/, /' we say / < /' if x < y for all x € / and y G i.e., if 
x(I) < x(I'). The interval I+x denotes the interval / shifted 
by x, i.e., I + x = [x(I) + x,x(I) + x]. For a non-empty 
interval / and e > by (I)_ t we mean (x(I) — e,x(I) + e). 

Lemma 27: Let /, I' G t> e distinct where / G 

^(-oo +oo) and to is regular. Then I < I 1 implies I+2W < I 1 . 

Proof: Since u> is regular, / is constant on (I) w and on 
(I') w - These two intervals must be distinct since / and I' are 
maximal, and the Lemma follows. ■ 

Given regular uj and shift s > we say / G ] is linked 
to I' G l[ gU ] if x(I) + W + s e I' , and we say / G Zjy*] is 
linked to I' G T-\f^>\ if x(I) +W € I' . If we have a sequence 
I\,l2,--- such that Ij is linked to then we call this a 
chain. The chain terminates if the last element in the chain is 
not linked to another interval. 

Lemma 28: Let (hf,h g ) G \t[ 01 ] satisfy the strictly pos- 
itive gap condition with A(hf,h g ) > 0. Let (/, g) G 
^(-oo +oc ) be interpolating and let uj be regular. Assume 
— hf and = (hence s > 0), then any 

chain in 2y^],I[ s ^] must terminate. 

Proof: Let (u*, i?*) be the minimal element in x°(/i/, h g ) 
as guaranteed by Lemma [9] There exists finite x* such that 
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g{x*) > u* and f(x*) > v* . Let (u, v) = (g(x),f(xj) where 
x € I € Z[ g ^\; then we have x < x*. It follows from Lemma 
|27l that any chain of linked intervals must terminate. ■ 
Lemma 29: Given (hf,h g ) that satisfy the strictly positive 
gap condition, we can find (hj,h g ) — > (hf,h g ) such that 
(hy, h l g ) satisfies the strictly positive gap condition for each i 
and all of the following properties hold 

A. J {h}) -i C J h -i , J( h *)-i C J h -i . 

C. If u G Jh- 1 H J77i / then hy(u) = hf(u) for all i large 
enough. 

If v G J h -i n Ju g then = h g (v) for all i large 

enough. 

D. If v G J, -i then 

If ii G J, -i then 

E. If w G ^T,,- 1 then, setting u = hf (v+), we have 
h l j:(u) = hf(u) for all i large enough. 

If u G i7/j-i then, setting u = h~ 1 (u+), we have h g (v) = 
h g (v) for all i large enough. 

Proof of Lemma \29$ Note that if Jj,. n J^-i = and 
Jh g H = then we can simply set (/i^, /i*) = (hf,h g ). 
Thus, the lemma targets the case where this does not hold. 

We will describe the construction of h\ , the construction of 
h g is analogous. 

Consider the countable set 

Jh f H J h -i = {ui,u 2 , ■ ■ ■} 

and also the set 

{hj^v-), hj 1 (v+) : v G J h7 i}\(J hf nJ h -i) = {h,t 2 , ...}. 

For each k = 1, 2, ... set 

d fc = mm{u fc , 1 - - |u fe - tj\ : j < k} 

For each j = 1, 2, ... we define sequences r)i ;k , k — 1, 2, . . . 
such that 

< %,fe < -mm{3- lk ,d k } 

and such that 

{u k ±r) itk }nj h -i =0. 

Note that 2Y, k Vi,k < jr- 

For each ft we associate a function H k which is a unit 
step function except we set Hk(0) — r k where r k = 
h \ L" + Ju^- ) ' ^ n * s f unc ti° n represents the jump in h / at 
itfc. We wifl substitute for this a function 

!0 x < 1 - i]i :k 

0V(.x-r fe )Al \x\<rn,k 
1 a; > 1 + 77i, fc 



where V z A 1 = min{max{0, z}, 1}. Define 

h){x) = h f (x)-J2(hf(u k +)-h f (u k -))(H k (x)-S itk (x)) . 

k 

Note that J2k( h f( u k+) - h f (u k -)) < 1 and \H k {x) - 
Si, k (x)\ < 1. The function h\{x) can be expressed as the 
sum of two functions, 

hi(x) = h f (x) - }Xhf(u k +) - h f {u k -))H k (x) 

k 

and 

h,2,i(x) = y^(/i/(ufc+) - hf(u k -))S ilk (x) , 

both of which are in ^[0.1], i.e., both of which are non- 
decreasing. If follows that hi G ^[o,i] and hy t " > °°> hf. 
We assume a similar definition of h g . 

We will now show that properties A through E hold for 
this sequence. Each property has two essentially equivalent 
forms, we will show the first form. Let v G J^p-i, which 
implies that there is non-empty interval I — (xi,X2) such 
that h\ is constant on /. Since both hi and 7i2,t are non- 
decreasing it follows that both are constant on /. From the fact 
that h,2,i is constant on / we easily obtain that ~^2 k {hf(u k +) — 
hf(u k —))H k (x) is also constant on / and we see that hf is 
constant on /. Hence v G J h - X and part A is proved. 

We have Si tk (u+) — Si. k (u—) = unless u = uj ±rij tk for 
some j, which implies u £ Ju-^ ■ Hence, /i2,i(u) is continuous 
for all u G Ju-i- The function hi is continuous for all u G 

tig 

J h -t n Jh t since H k (u+) - H k (u-) = 1 if u = u k and 
H k (u+) - H k (u-) = If u ^ itfe. If u e J h -i\J hf then hf 
is continuous at u and therefore hi is continuous at u. Hence, 
hf is continuous for all u G J h -^ and part B is proved. 

Let u G J h -i H iTh, , i.e., u — Uj for some j. We prove 
part C by showing that H k {uj) — Si ;k (uj) — for all k for 
all i large enough. For j = k we have H k (uj) — Si :k (uj) = 
by definition. For fc < j we have H k {uf) — Si tk (uj) = 
for all i large enough. This holds, in particular, if J| < 
minfc<j{|ufc - For j < ft we have H k (uj) — S^ k {uj) = 
by construction, i.e., from the requirement that r/i tk < d k 
which implies \uj — u k \ > r)i tk . This proves part C. 

Assume v G then hj (v— ) < Since 

fl Jj,, =0 it follows that for w G 
(h- f 1 (v~) + 2-\h- f 1 (v+)-2~ l ) we have ^(tt) = h f {u) = v 
and for u (£ (hj 1 ^-) - 2~* ,h' f ~ 1 (v+) + 2" 1 ) we have 
hy(u) ^ v. Part D now follows. 

Let v G J h -i and set u = hj 1 (v+). If u G n 
then u = u k for some ft and property C implies property E. 
Otherwise, we have u — t k for some ft. For j > k we have 
??i,/c < \uj— t k \. For i sufficiently large we |- < mi]ij<fe{|u 7 - — 
Hence property E holds. 

Now we address the question of the strictly positive gap 
condition. In general, we may need to modify the constructed 
sequence and take a subsequence. 

Define 

h s f = fi/VHfi - (1 - 5)) 
h 5 g = h g VU(x-(l-6)). 
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We claim that for all S sufficiently small (hi, h g ) satisfies the 
strictly positive gap condition. First, we choose 5 small enough 
so that A(h s f , h 5 g ) > 0. Then 

<p{h f ,h g ;u, v) - <p(h 5 f ,h g ;u, v) 

= {h-\x)-{h s g )-\x))dx+ {h-\x)-{h s f )-\x))dx 
Jo Jo 

which is non-negative and non-decreasing in u and v. Hence 

for (u,v) G x°(h S f,h 5 g ) C X°(hf,h g ) we have 

<j>(h 5 f ,h g ;u,v)-A(h f ,h g ) 
>4>{hf, h g ; u, v) - A(hf, h g ) 
>0 

which establishes the claim. Now for each S > we can 
choose rj sufficiently small so that 

U(x - rj) A h s f 
H(x — T)) Ahg 

still satisfies the strictly positive gap condition with A > 0. 

Let us define Sj — > and r\j — > with 1 — Sj, rjj g" Jl-i U 
J h -i so that, for each j, 

ti } = H(x - rjj) A h f (x) V H{x - (1 - Sj)) 
h g = H(x - rij) A h g (x) V H(x - (1 - Sj)) 

satisfies the strictly positive gap condition with A > 0. Now, 
for each i we define the sequence 

tf/(x) = H(x - rjj) A h){x) V U(x - (1 - fy)) 
hU(x) = H(x - n s ) A h g (x) V H(x - (1 - S 3 )) . 

Then we have 

hf ^ h) 

Clearly x°(h j f ,h g ) = x {hf,hg)n[r) j ,l-6 j ] 2 , and it follows 
that for each j, (h % f J \h g ^) satisfies the strictly positive gap 
condition with A(h l f J ,hy j ) > for all i large enough. 
Properties A and B still hold for all i and j. 

For each j we can find i(j) such that (h % f >h g ' J ) satisfies 
the strictly positive gap condition for all i > i(j). We 
can assume i(j) is increasing in j. Consider the diagonal 
sequence h g ^^) j = 1,2,.... Let us re-index this 

as (h\,hg)i = 1,2,... with corresponding 8i,r)i. We now 
show that properties C,D, and E continue to hold. 

Property C holds since, by Lemma [7] u G J\ lf implies 
u G (0,1) and v G Jh implies v G (0,1). Now we 
show property D. Assume v G J7, lT i. If v G (0,1) then 

[h~j l {v— ), h'J 1 (v+)} C (0,1) by Lemma [7] and property D 
clearly holds. If v = then hj 1 ^-) = (h f )- l (v-) = 
and hj 1 (v+) < 1 by Lemma [7] Since 1 — Si — > 1 we 
have (h l j)~ 1 (v+) ->• hj 1 (v+). Similarly, if v = 1 then 
/i^ 1 (w+) = (ftj.) _1 (<!;+) = 1 and hj 1 ^-) > and we have 
) — > hf(v—). Thus, property D holds generally. 



Finally we consider property E. Let v G J, -i and set it = 

/i* («+)• Then u > and if it < 1 then we have clearly 
have hf(u) = hf(u) for all i large enough. If u = 1 then 
hf(u) = 1 and hf(u) — 1 for all i. Thus, property E holds. 

■ 

For / G ^(-oo,+oo) we sa y that / is increasing to the right 
of x if z > x => /(z) > /(x) and we say that / is increasing 
to the left of x if z < x f(z) < f(x). 

Lemma 30: Let (hf,h g ) satisfy the strictly positive gap 
condition and let uj be regular with A(hf, h g ) > 0. Let (/, g) 
be interpolating such that / = hf o g u > s and g = h g o as 
guaranteed by Lemma |251 If / G Ir g w,»i, then / w is increasing 
to the right of x(J) — If J G 2r/ w ] , then <? w is increasing 
to the right of x(I) - W. 

Proof: Assume / G Z\gu,*] and let G denote g u ' s (I). 
Assume f u is not increasing to the right of x(I) — W. Then 
x(I) - W€l'e T[f U ] and x(I) - W < x(I'). Let F = 
f u (I'), then, since cj is regular, f(x) = F for x G 
Since x{F) + W> x(I) we have F = h g (G). 

Since s < 2W by Corollary |2] we have x(I) - s + W > 
x(I'). In addition we have g(x) = G on (/ — s)^ and it 
follows that G == ft. g (-F). 

We now have (G,F) G x(' 1 /i' l g)i but since 
<j>(hf,h g ;G,F) G [0,A] by Lemma [T7] this contradicts 
the strictly positive gap condition. ■ 

Lemma 31: Let (hf,h g ) satisfy the strictly positive gap 
condition with A(hf, h g ) > and let u be regular. Assume we 
have f,g e *(_oo,+oo) such that / = hfog" and g = h g of u ^ 
and /»—>•/ and gi ^ g and — ?> s where fi — hjo g^' Si 
and gj = /i* o/" for each i, and (h % f, h g ) — > (hf, h g ) is given 
as in Lemma |29l 

Then s > and the following properties hold. 

1. Let I G luw] and set G = 5^(1). If / is not linked to 
an /' G then for any e > we have gf(x) — G for 
£ G for all i large enough. 

2. Let J G Z[g U] and set G = g u (I). If / is linked to I' G 
X[j^] and for any 5 > we have f!f(x) = i 7, for a; G 
(If")_ s for all i large enough, then, for any e > we 
have gf{x) = G for x G for all i large enough. 

3. Let / G T\g<-,>] and set G = g u ' s (I). Assume that for 
any e > we have g^*'(x) = G for x G for 
all i large enough. Then we have f(x) = hf(G) for all 

xe(x(l),x(l)). 

Proof: Let (h l f,h g ) — >• (hf,h g ) be given as in Lemma 
|29l By Lemma |25l and Lemma [T9l there exists such that 
f i = h>\o gf and = h g o for each i. Let / and 5 be 
limits so that / = hf o g u and g == /i g o / w as guaranteed by 
Lemma [22] 

Let / G Ifgwi. We have g(x) = G for all x G Since 
f u is increasing to the right of x(I) — W by Lemma [30] and 
increasing to the left of x(I) + W by assumption we see by 
monotonicity of h g that h g (v) = G for all v G (f u (xi — 
W),f UJ (x 2 + W)) and G G J^-i . Given any e > property 
D of Lemma l29l now implies that (f u (xi - W + e), f"(x 2 + 
W)-e) c [(h g )- 1 (G-), (^)- 1 (G+)] for all i large enough. 
We conclude from this that gi(x) = G for x G (l) w _ e for all 
i large enough. This implies that gf(x) — G for x G 
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for all i large enough, proving part 1. 

Now we consider part 2. Let / be linked to /' G ^[/"l- 
We have G G J, -i since /" is increasing to the right of 
2.(7) — W. As in the proof of part 1 we have h g {v) = G for 
allue (f w (x!-W),F) 

We must have F = h g ~ 1 (G+) since I is maximal. 
We now apply property E of Lemma [29] to conclude that 
h g (F) = G for all i large enough. Given e > we combine 
this with property D to obtain (/"(xi - W + e),F] C 
[(/i ff ) _1 (G-), (h l g )- 1 {G+)} for all i large enough. Let (5 = e, 
then for all i large enough we also have f"(x) — F for 
x G (I')_ e - We conclude that <?j(a;) = G for x G (I) w _ e for 
all i large enough. This implies that gf(x) — G for x G (I)_ e 
for all i large enough, proving part 2. 

Consider part 3. Let I G T-\&>,*-\ and set G = g^' s {I). If ft-/ 
is continuous at G then we must have f(x) = hf(G) on I. 
Assume now that G G Sk,- We have G G J h -i by Lemma 
[30] since hf,h g satisfies the strictly positive gap condition. 
Property G of Lemma |29l now gives hj(G) — hf(G) for all 
i large enough. This implies that for any e > we now have 
fi(x) = hf(G) for all x G {I)_ e for all i large enough. Since 
fi — > f this proves part 3. ■ 

Lemma [31] essentially completes the proof of Theorem Q] 
and we state the main result as the following. 

Corollary 3: Let (hf,h g ) satisfy the strictly positive gap 
condition with A(hf,h g ) > and let cj be regular. There 
exists interpolating /, g such that / = hf o g u and g = h g o 

Proof: Let (/ij,/i g ) — > (hf,h g ) be given as in Lemma 
|29] By Lemma [25] and Lemma [19] there exists fi , gi such that 
fi = hjog^ and gi = h l g o for each i. Let / and g be 
limits so that / = hf o g u ' s and g = h g a f u as guaranteed 
by Lemma [22] 

By Lemma [28] shows that any element in I G I[ g ^] must be 
part of a terminating chain. Parts 1 and 2 of Lemma [31] show 
that for any e > we have g?(x) — g u (I) for all x G (-0_ e 
for all i large enough. Part 3 of Lemma [3T| then shows that 
f{x) = hf{g UJ ' B {x)) for all x in the interior of I. Lemma [T8l 
states that if f ^ hf o g u > s then there exists I G I[ g «] such 
that f(x) hf(g u ' s (x)) on a subset of positive measure in 
I - s. Hence, / = hf a g"> s . 

A similar argument shows that g = h g o f u . ■ 



Appendix D 

Proof of Theorem [2} Assume that w is a discrete 
sequence related to a regular smoothing kernel cj as indicated 
in (0. Let (hf,h g ) be a pair of functions in ^[0,1] satisfying 
the strictly positive gap condition. Let F, Q, s be the quantities 
guaranteed by Theorem [T] Consider system 

Assume f°(xi) < F(xi) (for all i). Let / denote the 
extension of f° to all of R by setting /(x) = f°(xi) for 
2: G A[i - \,i + i). It follows that < + A/2) 

for all x and that f w '°(xi) — f u (xi) for each i. Hence 
g°(xi) — h g (f°(xi)) < G(xi + A/2). By an argument similar 
to that used for /°, we obtain g w '°{xi) < Q u} {x l + A) . and 



we now have 

f 1 {x i ) = hf{g^\x i )) 

<h f (g u {xi + A)) 
= F(x t - s + A) . 

By induction we obtain 

f*(xi) < Fixi-tis-A)) 

All other cases can be treated similarly. ■ 
Proof of Theorem [5} Let (hf,h g ) satisfy the strictly 
positive gap condition, let uj be regular, and assume that 
A(hf,h g ) > 0. Consider the one-sided termination of ([3]). 
Define 

/•w-{; 

II x > 

We will show that /* — > 0, which implies the same 
for arbitrary initial condition. By monotonicity in t, /* 
has a point-wise limit f°° G ^(-00, +00) and g* has a 
point-wise limit g°° G ^(-oo +00) By continuity we have 

(/ 00 (+ ro ), 3 00 (+^)) exihfX)- 

Assume for the moment that (g° a (+oo), /°°(+oo)) = 
(1,1) and consider (fyyoo ^,=0], j^.ooj). 

It follows that h g (x) = h[ g =o j^,^](x) for almost all 
x G [0,1], that hf(x) — fyjoo^.oc] (x) for almost all a; G 
[# w '°°(0),l], and that ^^.^'(a;) =0fora;G [O,^' 00 ^)). 
We therefore have 

A(hf, hg) < A(/l [/0 O i9 C, t X, ] ,/l [s ,C. i/W ,00 ] ) = 

which is a contradiction. 

In general (h^^, ^.00] is well defined on [0,g°°(+oo)] and 
h[ g oa jco.ooi) is well defined on [0,/°°(+oo)] and we have 

0(/ l/ ,/ lg ; 5 oo (+oo),/ oo (+^)) 
<0(/i [/ ^ ! ^^ ] ,/i [g =e J ^=e ] ;g oo (+oo),/ oo (+oo)) (30) 
=0. 

Since (hf,h g ) satisfies the strictly positive gap condition and 

A(h f ,hg) > we conclude that (g°°(+oo), f°°(+oo)) = 
(0,0). ' 

Now consider the case A(hf,h g ) — and assume that 
hf{x) > and h g (x) > on (0, 1]. Assume that f°° ^ 0. 
Let z = sup{a; : f°°(x) = 0}. We have f u '°°(x) > on 
(z) w and therefore g°°(x) > on (z) w and g u >°°(x) > 
on (z) 2W . This implies that z = and that f°° is dis- 
continuous at 0. Applying the same argument as above we 
obtain again (l3Qb except that the inequality is strict (since 
(5 00 (+oo),/ 00 (+oo)) ^ (0,0)) and the conclusion holds. ■ 
Proof of Theorem® Let (hf,h g ) satisfy the strictly 
positive gap condition and assume that A(hf, h g ) > A^Hoo. 
Then f* — > for the one-sided termination of (O for any 
choice of /°. 

As above, we consider, 



Xi < 

1 Xi > 
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and show that /* — » 0. Consider 

h f (u) = h f (u)\/n(l-r 1 ) 
where we assume 77 > sufficiently small so that A(hf, h g ) > 

Ainu. 

By Theorem|2]there exists interpolating T and Q and s > A 
such that, even for the unterminated case, f°(xi) < JF(xi) 
implies f l (xi) < Tixi — (s — A)t) for all t. The same clearly 
holds also in the terminated case. Clearly, J-(x) = 1 for all 
x > z for some finite z, and by translation we can take z to 
be and we not obtain the desired result. ■ 
Proof of Theorem [7} We consider modifying of h f and 
h g as follows, hf = max{/i/ — 77,0} and h g — max{ft 9 — 
77,0}. Clearly, <j)(hf,h g ;) > (j)(hf,h g ;). Since hf and h g 
are continuous at and 1, by Lemma [7] we see that for 
77 sufficiently small there will exist at least one crossing 
point (u,v) G x°(hf, h g ), necessarily close to (1,1), where 
<fi(hf, hg] u* , v*) < 0. Denote the minimal such crossing point 
by (u* , v*). By making 77 small enough the point (u* , v*) will 
be arbitrarily close to (1,1), and we assume 77 sufficiently 
small so that u* , v* > 1 — e. 

We can now apply Theorem Q] with appropriate scaling, 
to (hf,h g ) on [0,u*] x [0,v*] to obtain interpolating F,Q G 
^[-00, 00] and s < so that setting f l (x) — (v*)T(x — st) 
and g*(x) = (u*)Q(x - st) solves © for (h f ,h g ). Clearly, 
T(x) = on some maximal interval and by translation we 
may take this interval to be [—00, 0). We also have Q(x) =0 
on some maximal interval [— 00, zo). 

Consider the two-sided terminated set-up. We assume Z > 
Azq large enough and 77 small enough so that 



u)(x)dx > - 
2 

{v*)T{^)>v* 
(u*)§(^)>u* 



rj 1 uj(x)dx > 

' max{0,zo } 



77 4 

n 



uj(x)dx . 



(31) 
(32) 
(33) 

(34) 



With a slight abuse of iteration indexing, let us initialize 
with 



r°( x ) 



-x) 



x<i 
x> f 



Clearly / w0 is symmetric about ^. Consider now 

g°(x) = h g (r°(x)). 
For x G (z , ~] we have 

g°(x) > {u*)g{x)+ri, 



(u*)G(x) = h g ((v*)F w (x)) 
= h 9 (r°(x)) 

= h g (r°( X ))- v 

and, in general, we have g°(x) > (u*)Q(x) for x G (—00, 



We wiU now show that g u0 {x) > (u*)§ u (x) on [0, f ]. For 
G [0, -|] we proceed 

poo 

g"°(x)= u(x-y)g°(y)dy 



>(u*) uj(x -y)G(y)dy + i] u{x - y)dy 



>(u*) u(x - y)Q{y)dy + r) j u{y)dy 

(34} Z" 00 _ 

> (u*) / u(x - y)Q{y)dy 

J — OO 

= (u*)G u (x), 
and for x G [4-, y] we proceed 

OO 



g u0 (x)= / cj(x-y)g°(y)dy 

3Z 

> / u(x-y)g°{y)dy 



>(u*)J u(x-y)g(y)dy + j z u(x - y)(G(^ ) + r,)dy 

i 1 z 3Z 

>{u*)J uj(x-y)g{y)dy + J z uj(x - y)(u* + -£)dy 

ED (~ 77 

> (u*) u(x-y)g(y)dy+j 

(3TJ ,.oo 



> (u*) / co(x - y)Q(y)dy 

J —OO 

Now, define f 1 by f{x) = hfig" ^)) for x G [0,Z] and 
/ 1 (s) = otherwise. It now follows that f x (x) > (y*)J r (x) + 
77 on [0, -j]. Using essentially the same argument as above, we 
have f^ix) > (v*)F u (x) on (-00, |] and hence / wl (x) > 

By monotonicity we see that /* is a point-wise increasing 
sequence that converges to a limit J 7 , and, similarly, <?* 
converges to a limit Q. If hf and are continuous then J 7 , C? 
constitutes a fixed point solution. In the discontinuous case 
initializing with T may lead to another increasing sequence. 
As in the proof of Theorem |U in general we can apply 
transfinite recursion and use monotonicity in x up to ^ 
existence of a fixed point solution for which J 7 , Q is a lower 
bound. We omit further details. 

Finally, note that we have T{x) > v* + > 1 — e and 
G(x)>u*+ 7 f >l- eon [f,f]. ' ■ 

Proof of Theorem [5} The proof is similar to the proof 
of Lemma [7] We consider the modification hf,h g as in the 
proof of Lemma [7] except that we define (u*,v*) so that 
§(hf,h g ;u*,v*) < — AH^Hoo- As before, we assume 77 
sufficiently small so that u*,v* > 1 — e. 

We can now apply Theorem [2] with appropriate scaling, 
to (hf,h g ) on [0,u*] x [0,v*] to obtain interpolating T ,Q G 
^[-oo.oo] an d s < -A (actually we have s < —A/(u*v*)) 
so that we have f t (x i ) < (v*)J 7 (x i — (s + A)t) and g'(x) < 
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{u*)G[x z (s + A)t) provided f°(xi) < (v*)T(xi) under © 
for (hf,h g ). Clearly, J-(x) = on some maximal interval 
and by translation we may take this interval to be [— oo,0). 
We also have Q{x) = on some maximal interval [— oo,z )- 
Consider the two-sided terminated set-up. We assume Z > 
4zq + 2A large enough and 77 small enough so that 

to(x)dx> --j > -, (35) 

( v *)?(l-A)>v*- 1 l, (36) 

(u*)Q{^-A)>u* (37) 

/>00 

T) I uj(x)dx > / uj(x)dx . (38) 

/max{0,2 } + A/2 J§ 

With a slight abuse of iteration indexing, let us initialize 
with 

f w0, ^_ \{v*)F"{Xi) *<<f 

Clearly / w0 is symmetric about ^. Consider now 

g\ Xl ) = h g (r°( Xl )). 
For Xi £ (zq, §■] we have 

9°(xi) > (u*)g(xi)+r), 

since 

{u*)§{ Xi ) = h g {{v*)r"(xi)) 
= h g (r°( Xi )) 

^h^r^x^-v 

and, in general, we have g a (xi) > (u*)Q(xi) for Xi G 
(-oo, f]. 

We will now show that g w °(x l ) > (u*)g ul (x l ) on [0, §]. 
Let <7° be the piecewise constant extension of g°. 
For Xi <E [0, -f ] we have 



where the second inequality uses d38l ) and the fact that x G 
[0, f ]. For a: e [f , f ] we have 

/OO 
c^-y)£f°(y)dy 
-00 

> / -y)g°(y)dy 

J — OO 

Z_ 

>(u*) r wfo - - A/2)dy 

*/ —OO 

/■¥ 

+ / w(a:i-y)(0(f -A/2) + 77^ 



§(u*) / 4 wfo - - A/2)dy 

J —OO 
f — 

+ I 4 w(a: i -y)(ti* + ^)dy 

>(«*)/ - y)g(y - A/2% + j 

(35) r°° ~ 

> (u*) / wfo - - A/2)dy 

= (u*)S w (x-A/2) 



where the last inequality uses 

Now, define f 1 by f 1 (x l ) = hf(g w0 (x t )) for [0,Z] and 
f (xi) = otherwise. It now follows that we have f 1 (xi) > 
(v*)T(xi — A/2) + 7/ on [0, 4]. Using essentially the same 
argument as above, we have f wl (xi) > [v*)J-^{xi — A — s) 
on (-00, f ] and hence f wl { Xl ) > f wQ (xi). 

By monotonicity we see that /* is a point-wise increasing 
sequence and therefore converges to a limit T and <?' con- 
verges to Q. We note that T(x t ) > v* + ^ > I — e and 



e on 



g( Xi ) >u* + f>i 

For continuous hf,h g we can conclude that (J 7 , £7) is a fixed 
point and in general we can conclude that the system has a 
fixed point lower bounded by (J 7 , Q). ■ 



1 

z_ 

> (u*) ( 2 cj(x i -y)g(y-A/2)dy 



+ rj I uj(xi - y)dy 

'zo+A/2 
z_ 

>(«*)/"" w(xi-y)g(y-A/2)dy 



+ rj I u(y)dy 

'zo+A/2-x, 

{38} r°° 

> (u*) / u{ Xl - y)g(y ~ A/2)dy 

./ — CO 

= (u*)^'(s i -A/2) 
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